00000001:02000400:2.0F:1790710596.923535:0:2966:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg646-server.virtnet: executing set_hostid 00000001:02000400:0.0F:1790710613.799195:0:3187:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg646-server.virtnet: executing load_modules_local 00000001:01000000:2.0:1790710615.756278:0:3249:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 875 MB/s 00000001:01000000:0.0:1790710616.006394:0:3249:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1015 MB/s 00000001:01000000:2.0:1790710616.256312:0:3249:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4263 MB/s 00000020:02000000:2.0:1790710617.235430:0:3278:0:(class_obd.c:846:obdclass_init()) Lustre: Build Version: 2.17.59_2_g598166e 00000400:02000000:2.0:1790710618.307234:0:3293:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.206.146@tcp [8/256/0/180] 00008000:02000000:0.0:1790710621.751863:0:3443:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0F:1790710665.160016:0:5248:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg646-server.virtnet: executing load_modules_local 00000020:01000004:1.0F:1790710675.840343:0:5825:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1790710675.840352:0:5825:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1790710675.840668:0:5825:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000bd211d4f 00000080:02000400:1.0:1790710675.840679:0:5825:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' or install '{/usr}/sbin/mount.lustre_tgt' 00000020:01000004:1.0:1790710675.851104:0:5825:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1790710675.851117:0:5825:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1790710675.851196:0:5825:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000003202501d) 00000020:00000080:1.0:1790710675.851214:0:5825:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1790710675.876375:0:5825:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1790710675.876711:0:5825:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1790710675.917765:0:5825:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1790710675.917806:0:5825:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1790710675.918116:0:5825:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1790710675.918288:0:5825:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1790710675.918312:0:5825:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1790710675.918650:0:5825:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1790710675.918657:0:5825:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1790710675.918667:0:5825:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcbad34b2815709f3 00000020:01000004:2.0:1790710675.918674:0:5825:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1790710675.918678:0:5825:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1790710675.918683:0:5825:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000bd211d4f from MGS 00000020:01000004:2.0:1790710675.918687:0:5825:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1790710675.918703:0:5825:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000004932e620) 00000020:00000080:2.0:1790710675.918714:0:5825:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1790710675.918804:0:5825:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000bd211d4f from MGS, refs=2 00080000:01000000:2.0:1790710675.918809:0:5825:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1790710675.918815:0:5825:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcbad34b281570a01 00000100:00100000:2.0:1790710675.919346:0:5825:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1790710675.919669:0:5825:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1790710675.919675:0:5825:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1790710675.925380:0:5825:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1790710675.925395:0:5825:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1790710675.926478:0:5825:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790710675.926655:0:5825:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1790710675.926661:0:5825:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1790710675.938507:0:5825:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1790710675.938519:0:5825:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1790710675.938812:0:5825:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1790710675.938818:0:5825:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1790710675.939500:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790710675.939503:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790710675.939504:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790710675.939736:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790710675.939738:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790710675.939740:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790710675.940561:0:5825:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1790710675.949111:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:1.0:1790710676.189253:0:5825:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2599 MB/s 00000001:01000000:2.0:1790710676.439261:0:5825:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 6519 MB/s 00000001:01000000:3.0:1790710676.689956:0:5825:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 747 MB/s 00000001:01000000:3.0:1790710676.939861:0:5825:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 479 MB/s 00080000:10000000:3.0:1790710676.953591:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:1.0:1790710676.979238:0:5825:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1790710676.979255:0:5825:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1790710676.979258:0:5825:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1790710676.981035:0:5836:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1790710676.981122:0:5825:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1790710676.981209:0:5825:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1790710676.981410:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1790710676.981448:0:5825:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1790710676.981760:0:5825:0:(service.c:173:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790710676.981905:0:5825:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1790710676.981911:0:5825:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1790710676.983890:0:5825:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1790710676.983900:0:5825:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1790710676.990585:0:5825:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1790710676.990599:0:5825:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1790710676.995017:0:5825:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1790710676.995039:0:5825:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.146@tcp' 00000020:01000004:2.0:1790710676.995042:0:5825:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1790710676.995099:0:5825:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.146@tcp (typ=mgc) 00000020:00000080:2.0:1790710676.995111:0:5825:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.146@tcp (000000001a320a18) 00000020:00000080:2.0:1790710676.995779:0:5825:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1790710676.995874:0:5825:0:(ldlm_lib.c:102:import_set_conn()) imp 000000008778b328@MGC192.168.206.146@tcp: add connection 192.168.206.146@tcp at head 00010000:00010000:2.0:1790710676.996044:0:5825:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.146@tcp-0 is initialized 00000040:01000000:2.0:1790710676.996050:0:5825:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.146@tcp ctxt 1 is initialized 00000100:00080000:1.0:1790710676.997089:0:5841:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1790710676.997738:0:5842:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1790710676.998273:0:5825:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.146@tcp (uuid 5d27fc27-b651-404a-bd8c-b798806fb18a) 00000020:00000080:1.0:1790710676.998292:0:5825:0:(genops.c:1384:class_connect()) connect: client 5d27fc27-b651-404a-bd8c-b798806fb18a, cookie 0xcbad34b281570a0f 00000100:00080000:1.0:1790710676.998303:0:5825:0:(import.c:545:import_select_connection()) MGC192.168.206.146@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790710676.998310:0:5825:0:(import.c:666:import_select_connection()) MGC192.168.206.146@tcp: import 000000008778b328 using connection 192.168.206.146@tcp/0@lo 00000100:00100000:1.0:1790710676.998349:0:5825:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000f9011dce x1877696176980096/t0(0) o250->MGC192.168.206.146@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790710676.998367:0:5825:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 5d27fc27-b651-404a-bd8c-b798806fb18a->MGS 00000020:01000004:1.0:1790710676.998384:0:5825:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1790710676.998389:0:5825:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1790710676.998400:0:5825:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000091196a28) 00000020:00000080:1.0:1790710676.998411:0:5825:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1790710676.999633:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f9011dce pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5d27fc27-b651-404a-bd8c-b798806fb18a:3308:1877696176980096:0@lo:250: 00000100:00100000:2.0:1790710676.999724:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710676.999794:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176980096 00000100:00100000:2.0:1790710676.999802:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176980096 00000100:00100000:2.0:1790710676.999829:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790710676.999835:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000007803eba0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3308:x1877696176980096:12345-0@lo:250: 00010000:00080000:2.0:1790710676.999860:0:5837:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 5d27fc27-b651-404a-bd8c-b798806fb18a@0@lo t0 exp 0000000000000000 cur 154 last 0 00000020:00000080:2.0:1790710676.999882:0:5837:0:(genops.c:1384:class_connect()) connect: client 5d27fc27-b651-404a-bd8c-b798806fb18a, cookie 0xcbad34b281570a1d 00000100:00080000:2.0:1790710677.000013:0:5837:0:(import.c:65:import_set_state_nolock()) 0000000047cdf698 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790710677.000078:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000007803eba0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+5:3308:x1877696176980096:12345-0@lo:250: Request processed in 241us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710677.000086:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790710677.000153:0:3308:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.206.146@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1790710677.000162:0:3308:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.206.146@tcp: connect to target with instance 0 00000100:00080000:2.0:1790710677.000168:0:3308:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.206.146@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1790710677.000172:0:3308:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1790710677.000175:0:3308:0:(import.c:65:import_set_state_nolock()) 000000008778b328 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1790710677.000177:0:3308:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1790710677.000186:0:3308:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1790710677.000190:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f9011dce pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5d27fc27-b651-404a-bd8c-b798806fb18a:3308:1877696176980096:0@lo:250: 00010000:00010000:3.0:1790710677.005193:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790710677.020506:0:5825:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790710677.020691:0:5825:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1790710677.020704:0:5825:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1790710677.021552:0:5825:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1790710677.021561:0:5825:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1790710677.022351:0:5825:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1790710677.022358:0:5825:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1790710677.023054:0:5825:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790710677.023268:0:5825:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1790710677.023273:0:5825:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1790710677.023813:0:5825:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1790710677.023820:0:5825:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1790710677.094341:0:5825:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790710677.094666:0:5825:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1790710677.094672:0:5825:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1790710677.095781:0:5825:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1790710677.095790:0:5825:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1790710677.096653:0:5825:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790710677.097109:0:5825:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1790710677.097115:0:5825:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1790710677.097962:0:5825:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1790710677.097970:0:5825:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1790710677.098937:0:5825:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790710677.099108:0:5825:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1790710677.099114:0:5825:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1790710677.099872:0:5825:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1790710677.099879:0:5825:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1790710677.100738:0:5825:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790710677.100887:0:5825:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1790710677.100893:0:5825:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1790710677.104923:0:5825:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1790710677.104935:0:5825:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1790710677.152050:0:5825:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790710677.152306:0:5825:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1790710677.152313:0:5825:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1790710677.153557:0:5825:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1790710677.153566:0:5825:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1790710677.157726:0:5825:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1790710677.157746:0:5825:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1790710677.158882:0:5825:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1790710677.158905:0:5825:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1790710677.158911:0:5825:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.146@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1790710677.159028:0:5825:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.146@tcp ctxt 0 is initialized 00000020:01000004:3.0:1790710677.159384:0:5825:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.146@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1790710677.159389:0:5825:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1790710677.159391:0:5825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790710677.159392:0:5825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790710677.159393:0:5825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790710677.159394:0:5825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790710677.159396:0:5825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790710677.159397:0:5825:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790710677.159399:0:5825:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790710677.159400:0:5825:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790710677.159402:0:5825:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790710677.159403:0:5825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790710677.159405:0:5825:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790710677.159408:0:5825:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1790710677.159410:0:5825:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790710677.159411:0:5825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790710677.159412:0:5825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790710677.159413:0:5825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790710677.159414:0:5825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790710677.159415:0:5825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790710677.159416:0:5825:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790710677.159417:0:5825:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790710677.159418:0:5825:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790710677.159419:0:5825:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790710677.159420:0:5825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790710677.159421:0:5825:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790710677.159524:0:5825:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1790710677.159607:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000079275a06 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:5825:1877696176980224:0@lo:253: 00000100:00100000:3.0:1790710677.159706:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710677.159799:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f29c78b3 going to sleep for 11 seconds 00000100:00100000:1.0:1790710677.159906:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176980224 00000100:00100000:1.0:1790710677.159914:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176980224 00000100:00100000:1.0:1790710677.159999:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790710677.160008:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000005ed11d4c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+5:5825:x1877696176980224:12345-0@lo:253: 20000000:01000000:1.0:1790710677.160064:0:5840:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1790710677.160067:0:5840:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1790710677.161744:0:5861:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1790710677.161805:0:5840:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1790710677.162310:0:5840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790710677.164535:0:5862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1790710677.164801:0:5840:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1790710677.164805:0:5840:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1790710677.164811:0:5840:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1790710677.164814:0:5840:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1790710677.164829:0:5840:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1790710677.165034:0:5840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790710677.165422:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1790710677.165622:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1790710677.165672:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1790710677.165719:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1790710677.165755:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1790710677.165851:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1790710677.165860:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1790710677.165920:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1790710677.165929:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1790710677.165961:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1790710677.165969:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1790710677.166001:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1790710677.166292:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1790710677.166325:0:5840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1790710677.166340:0:5840:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1790710677.166356:0:5840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790710677.166709:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1790710677.166719:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1790710677.166756:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1790710677.166794:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1790710677.166843:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1790710677.166856:0:5840:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1790710677.166926:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1790710677.166935:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1790710677.166981:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1790710677.167020:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1790710677.167211:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1790710677.167224:0:5840:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1790710677.167307:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1790710677.167316:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1790710677.167349:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1790710677.167383:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1790710677.167727:0:5840:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1790710677.167785:0:5840:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1790710677.167792:0:5840:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1790710677.168358:0:5863:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1790710677.168987:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1790710677.169011:0:5840:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.206.146@tcp for mdt 20000000:01000000:1.0:1790710677.169013:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.146@tcp (null) (null) (null) 00000040:00080000:1.0:1790710677.169068:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1790710677.169076:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1790710677.169107:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1790710677.169115:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.206.146@tcp (null) (null) 00000040:00080000:1.0:1790710677.169948:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1790710677.169964:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1790710677.170001:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1790710677.170039:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1790710677.170124:0:5840:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1790710677.172902:0:5840:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1790710677.172909:0:5840:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1790710677.172917:0:5840:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1790710677.174347:0:5864:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:2.0:1790710677.174589:0:5840:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1790710677.201598:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1790710677.201679:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:3.0:1790710677.201797:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:3.0:1790710677.201818:0:5840:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1790710677.201820:0:5840:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1790710677.201823:0:5840:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1790710677.201836:0:5840:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1790710677.201838:0:5840:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1790710677.201869:0:5840:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1790710677.201872:0:5840:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1790710677.204040:0:5865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:3.0:1790710677.204957:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:3.0:1790710677.205015:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:3.0:1790710677.205091:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 20000000:01000000:3.0:1790710677.205106:0:5840:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1790710677.205108:0:5840:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1790710677.208386:0:5866:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1790710677.209888:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1790710677.209942:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1790710677.209988:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:3.0:1790710677.210003:0:5840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1790710677.210006:0:5840:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:3.0:1790710677.210014:0:5840:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1790710677.210036:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000002175ffac/0xcbad34b281570a24 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710677.210053:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002175ffac/0xcbad34b281570a24 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710677.210062:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002175ffac/0xcbad34b281570a24 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710677.210067:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002175ffac/0xcbad34b281570a24 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710677.210072:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000002175ffac/0xcbad34b281570a24 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710677.210099:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000002175ffac/0xcbad34b281570a24 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710677.210105:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002175ffac already unused, calling callback (00000000ed8a1e61) 00010000:00010000:3.0:1790710677.210108:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000002175ffac/0xcbad34b281570a24 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710677.210115:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000002175ffac/0xcbad34b281570a24 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710677.212797:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000002175ffac/0xcbad34b281570a24 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710677.212820:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000002175ffac/0xcbad34b281570a24 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710677.212825:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002175ffac/0xcbad34b281570a24 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1790710677.212845:0:5840:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1790710677.430420:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000005ed11d4c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+5:5825:x1877696176980224:12345-0@lo:253: Request processed in 270407us (270708us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710677.430450:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790710677.430510:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000079275a06 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:5825:1877696176980224:0@lo:253: 10000000:01000000:3.0:1790710677.430580:0:5825:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1790710677.430584:0:5825:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790710677.430586:0:5825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790710677.430588:0:5825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790710677.430589:0:5825:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1790710677.430598:0:5825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790710677.430600:0:5825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790710677.430601:0:5825:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790710677.430602:0:5825:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790710677.430604:0:5825:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1790710677.430617:0:5825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790710677.430618:0:5825:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1790710677.430637:0:5825:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000bd211d4f from lustre-MDT0000 10000000:01000000:3.0:1790710677.430658:0:5825:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1790710677.430661:0:5825:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1790710677.430664:0:5825:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9c51d02d19c0 10000000:01000000:3.0:1790710677.430668:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790710677.430675:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9c51d02d19c0 from 1 10000000:01000000:3.0:1790710677.430677:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1790710677.430709:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.146@tcp lock: 000000002175ffac/0xcbad34b281570a2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710677.430719:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.146@tcp lock: 000000002175ffac/0xcbad34b281570a2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710677.430728:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.146@tcp lock: 000000002175ffac/0xcbad34b281570a2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710677.430745:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000079275a06 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:5825:1877696176980352:0@lo:101: 00000100:00100000:3.0:1790710677.430780:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710677.430891:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176980352 00000100:00100000:0.0:1790710677.430898:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176980352 00000100:00100000:3.0:1790710677.430958:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d9f7e31a going to sleep for 11 seconds 00000100:00100000:2.0:1790710677.435865:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790710677.435883:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000043516775 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+5:5825:x1877696176980352:12345-0@lo:101: 00010000:00010000:2.0:1790710677.435903:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790710677.435926:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000833dff9c/0xcbad34b281570a32 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbad34b281570a2b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710677.435951:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000833dff9c/0xcbad34b281570a32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbad34b281570a2b expref: 6 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710677.435961:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000833dff9c/0xcbad34b281570a32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281570a2b expref: 6 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710677.435969:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000833dff9c, rc 0) 00000100:00100000:2.0:1790710677.436112:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000043516775 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+6:5825:x1877696176980352:12345-0@lo:101: Request processed in 237us (5331us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710677.436120:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790710677.436533:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000079275a06 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:5825:1877696176980352:0@lo:101: 00010000:00010000:3.0:1790710677.436551:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.146@tcp lock: 000000002175ffac/0xcbad34b281570a2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570a32 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710677.436559:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.146@tcp lock: 000000002175ffac/0xcbad34b281570a2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbad34b281570a32 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710677.436624:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000079275a06 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:5825:1877696176980480:0@lo:501: 00000100:00100000:3.0:1790710677.436659:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710677.436799:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d9f7e31a going to sleep for 11 seconds 00000100:00100000:0.0:1790710677.437704:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176980480 00000100:00100000:0.0:1790710677.437713:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176980480 00000100:00100000:1.0:1790710677.437906:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790710677.437915:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000009cc5870e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+6:5825:x1877696176980480:12345-0@lo:501: 00000100:00100000:1.0:1790710677.438211:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000009cc5870e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+6:5825:x1877696176980480:12345-0@lo:501: Request processed in 297us (1552us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790710677.438219:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790710677.438306:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000079275a06 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:5825:1877696176980480:0@lo:501: 10000000:01000000:3.0:1790710677.438336:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.146@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1790710677.438349:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: 000000002175ffac/0xcbad34b281570a2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570a32 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710677.438358:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.146@tcp lock: 000000002175ffac/0xcbad34b281570a2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570a32 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790710677.438367:0:5825:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c51c67ea000 10000000:01000000:3.0:1790710677.438372:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1790710677.438376:0:5825:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9c51c67ea000 10000000:01000000:3.0:1790710677.438379:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1790710677.438382:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9c51c67ea000 from 1 10000000:01000000:3.0:1790710677.438384:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1790710677.438408:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.146@tcp lock: 00000000c191315a/0xcbad34b281570a39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710677.438428:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.146@tcp lock: 00000000c191315a/0xcbad34b281570a39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710677.438436:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.146@tcp lock: 00000000c191315a/0xcbad34b281570a39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710677.438451:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000079275a06 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:5825:1877696176980608:0@lo:101: 00000100:00100000:3.0:1790710677.438481:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710677.439017:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d9f7e31a going to sleep for 11 seconds 00000100:00100000:2.0:1790710677.439222:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176980608 00000100:00100000:2.0:1790710677.439228:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176980608 00000100:00100000:2.0:1790710677.439265:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790710677.439271:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000005af5c191 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+6:5825:x1877696176980608:12345-0@lo:101: 00010000:00010000:2.0:1790710677.439281:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790710677.439292:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c80ad3c8/0xcbad34b281570a40 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbad34b281570a39 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710677.439311:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c80ad3c8/0xcbad34b281570a40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbad34b281570a39 expref: 7 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710677.439320:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c80ad3c8/0xcbad34b281570a40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281570a39 expref: 7 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710677.439326:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c80ad3c8, rc 0) 00000100:00100000:2.0:1790710677.439372:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000005af5c191 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+7:5825:x1877696176980608:12345-0@lo:101: Request processed in 101us (891us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710677.439379:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790710677.439569:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000079275a06 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:5825:1877696176980608:0@lo:101: 00010000:00010000:3.0:1790710677.439581:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.146@tcp lock: 00000000c191315a/0xcbad34b281570a39 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570a40 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710677.439604:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.146@tcp lock: 00000000c191315a/0xcbad34b281570a39 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbad34b281570a40 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790710677.439618:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.146@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1790710677.439800:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: 00000000c191315a/0xcbad34b281570a39 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570a40 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710677.439808:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.146@tcp lock: 00000000c191315a/0xcbad34b281570a39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570a40 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790710677.439815:0:5825:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1790710677.439819:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790710677.439824:0:5825:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9c51c67ea000 10000000:01000000:3.0:1790710677.439826:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1790710677.439829:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1790710677.439832:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1790710677.439848:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.146@tcp lock: 0000000003c70af2/0xcbad34b281570a47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710677.439855:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.146@tcp lock: 0000000003c70af2/0xcbad34b281570a47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710677.439862:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.146@tcp lock: 0000000003c70af2/0xcbad34b281570a47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710677.439874:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000079275a06 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:5825:1877696176980736:0@lo:101: 00000100:00100000:3.0:1790710677.439902:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710677.439921:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d9f7e31a going to sleep for 11 seconds 00000100:00100000:2.0:1790710677.440052:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176980736 00000100:00100000:2.0:1790710677.440057:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176980736 00000100:00100000:2.0:1790710677.440078:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790710677.440083:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000053bd20d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+7:5825:x1877696176980736:12345-0@lo:101: 00010000:00010000:2.0:1790710677.440090:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790710677.440097:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b2ab5355/0xcbad34b281570a4e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbad34b281570a47 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710677.440109:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b2ab5355/0xcbad34b281570a4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbad34b281570a47 expref: 8 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710677.440115:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b2ab5355/0xcbad34b281570a4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281570a47 expref: 8 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710677.440171:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b2ab5355, rc 0) 00000100:00100000:2.0:1790710677.440383:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000053bd20d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+8:5825:x1877696176980736:12345-0@lo:101: Request processed in 299us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710677.440389:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790710677.440668:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000079275a06 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:5825:1877696176980736:0@lo:101: 00010000:00010000:3.0:1790710677.440682:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.146@tcp lock: 0000000003c70af2/0xcbad34b281570a47 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570a4e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710677.440690:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.146@tcp lock: 0000000003c70af2/0xcbad34b281570a47 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbad34b281570a4e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710677.440737:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000079275a06 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:5825:1877696176980864:0@lo:501: 00000100:00100000:3.0:1790710677.440765:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710677.440854:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d9f7e31a going to sleep for 11 seconds 00000100:00100000:1.0:1790710677.440890:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176980864 00000100:00100000:1.0:1790710677.440895:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176980864 00000100:00100000:1.0:1790710677.440962:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790710677.440976:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000086ed8a02 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+8:5825:x1877696176980864:12345-0@lo:501: 00000100:00100000:1.0:1790710677.441320:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000086ed8a02 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+9:5825:x1877696176980864:12345-0@lo:501: Request processed in 344us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710677.441327:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790710677.441771:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000079275a06 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:5825:1877696176980864:0@lo:501: 00000100:00100000:3.0:1790710677.441803:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000079275a06 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:5825:1877696176980992:0@lo:503: 00000100:00100000:3.0:1790710677.441841:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710677.445021:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d9f7e31a going to sleep for 11 seconds 00000100:00100000:2.0:1790710677.445351:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176980992 00000100:00100000:2.0:1790710677.445361:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176980992 00000100:00100000:2.0:1790710677.445407:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790710677.445427:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000002c6fa4c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+9:5825:x1877696176980992:12345-0@lo:503: 00000100:00100000:2.0:1790710677.445836:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000002c6fa4c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+9:5825:x1877696176980992:12345-0@lo:503: Request processed in 421us (3993us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710677.445844:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790710677.446037:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000079275a06 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:5825:1877696176980992:0@lo:503: 00000100:00100000:3.0:1790710677.447407:0:5868:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000079275a06 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d27fc27-b651-404a-bd8c-b798806fb18a:5868:1877696176981120:0@lo:502: 00000100:00100000:3.0:1790710677.447602:0:5868:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710677.447678:0:5868:0:(client.c:2716:ptlrpc_set_wait()) set 000000008242ea54 going to sleep for 11 seconds 00000100:00100000:2.0:1790710677.447719:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176981120 00000100:00100000:2.0:1790710677.447726:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176981120 00000100:00100000:2.0:1790710677.447807:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790710677.447815:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000090331736 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+9:5868:x1877696176981120:12345-0@lo:502: 00000100:00100000:2.0:1790710677.448024:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000090331736 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+9:5868:x1877696176981120:12345-0@lo:502: Request processed in 210us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710677.448032:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790710677.448113:0:5868:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000079275a06 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d27fc27-b651-404a-bd8c-b798806fb18a:5868:1877696176981120:0@lo:502: 00000020:01000000:3.0:1790710677.448169:0:5868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790710677.448180:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790710677.448182:0:5868:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1790710677.448186:0:5868:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1790710677.448190:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790710677.448221:0:5868:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000784eaa2a) 00000020:00000080:3.0:1790710677.448249:0:5868:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1790710677.448263:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1790710677.448363:0:5868:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:3.0:1790710677.448378:0:5868:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcbad34b281570a5c 00000020:00000080:3.0:1790710677.448603:0:5868:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1790710677.448607:0:5868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790710677.448611:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790710677.448612:0:5868:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1790710677.448614:0:5868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790710677.448618:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790710677.448619:0:5868:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1790710677.448622:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790710677.448629:0:5868:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000c3303a10) 00000020:00000080:3.0:1790710677.448639:0:5868:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1790710677.448643:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1790710677.448645:0:5868:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1790710677.448648:0:5868:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1790710677.448653:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1790710677.448705:0:5868:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000bd211d4f from lustre-MDT0000, refs=3 00000020:00000080:3.0:1790710677.448717:0:5868:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000244d364f) 00000020:00000080:3.0:1790710677.448725:0:5868:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1790710677.448778:0:5868:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1790710677.448783:0:5868:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcbad34b281570a71 00000020:00000080:3.0:1790710677.448868:0:5868:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1790710677.448874:0:5868:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1790710677.448877:0:5868:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xcbad34b281570a78 00080000:01000000:3.0:1790710677.448881:0:5868:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:3.0:1790710677.448884:0:5868:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcbad34b281570a7f 00080000:10000000:3.0:1790710677.449653:0:5868:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1790710677.449825:0:5868:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1790710677.461456:0:5868:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:1.0:1790710677.576668:0:5868:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:1.0:1790710677.577423:0:5868:0:(tgt_lastrcvd.c:1879:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:1.0:1790710677.581259:0:5868:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1790710677.582039:0:5868:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1790710677.631932:0:5868:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000a8cfbdde) 00000020:00000080:2.0:1790710677.631953:0:5868:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1790710677.638748:0:5868:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:2.0:1790710677.638766:0:5868:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcbad34b281570a8d 00000020:00000080:3.0:1790710677.642448:0:5868:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1790710677.649105:0:5868:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:3.0:1790710677.703275:0:5868:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1790710677.743046:0:5868:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1790710677.790909:0:5868:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:3.0:1790710677.840424:0:5868:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:2.0:1790710677.918594:0:5868:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:3.0:1790710678.003257:0:5868:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xcbad34b281570a94 00000020:00000080:3.0:1790710678.004167:0:5868:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1790710678.004179:0:5868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790710678.004187:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790710678.004189:0:5868:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1790710678.004192:0:5868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790710678.004198:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790710678.004200:0:5868:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1790710678.004203:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1790710678.004240:0:5868:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1790710678.004254:0:5868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790710678.004257:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790710678.004258:0:5868:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1790710678.004260:0:5868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790710678.004263:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790710678.004264:0:5868:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:3.0:1790710678.004266:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1790710678.004268:0:5868:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1790710678.004320:0:5868:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000079275a06 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d27fc27-b651-404a-bd8c-b798806fb18a:5868:1877696176981248:0@lo:502: 00000100:00100000:3.0:1790710678.004395:0:5868:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710678.004455:0:5868:0:(client.c:2716:ptlrpc_set_wait()) set 000000008242ea54 going to sleep for 11 seconds 00000100:00100000:1.0:1790710678.005476:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176981248 00000100:00100000:1.0:1790710678.005487:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176981248 00000100:00100000:1.0:1790710678.005548:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790710678.005556:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000e2d9ae56 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+9:5868:x1877696176981248:12345-0@lo:502: 00000100:00100000:1.0:1790710678.005952:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000e2d9ae56 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+9:5868:x1877696176981248:12345-0@lo:502: Request processed in 397us (1558us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710678.005961:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790710678.006264:0:5868:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000079275a06 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d27fc27-b651-404a-bd8c-b798806fb18a:5868:1877696176981248:0@lo:502: 00000020:01000000:2.0:1790710678.006293:0:5868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790710678.006300:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790710678.006321:0:5868:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000040:00080000:2.0:1790710678.006326:0:5868:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1790710678.010281:0:5825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1790710678.010326:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.146@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1790710678.010344:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: 0000000003c70af2/0xcbad34b281570a47 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570a4e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710678.010357:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.146@tcp lock: 0000000003c70af2/0xcbad34b281570a47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570a4e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790710678.010366:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c51c67ea000 from 1 10000000:01000000:1.0:1790710678.010369:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790710678.010409:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.146@tcp lock: 0000000088a37ce1/0xcbad34b281570a9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710678.010432:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.146@tcp lock: 0000000088a37ce1/0xcbad34b281570a9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710678.010443:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.146@tcp lock: 0000000088a37ce1/0xcbad34b281570a9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710678.010465:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002203b0f4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:5825:1877696176981376:0@lo:101: 00000100:00100000:1.0:1790710678.011053:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710678.011112:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 00000000097bcd14 going to sleep for 11 seconds 00000100:00100000:3.0:1790710678.011293:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176981376 00000100:00100000:3.0:1790710678.011301:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176981376 00000100:00100000:3.0:1790710678.011359:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790710678.011366:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000007bb9795c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+9:5825:x1877696176981376:12345-0@lo:101: 00010000:00010000:3.0:1790710678.011380:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790710678.011393:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a1b1f0bc/0xcbad34b281570aa2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbad34b281570a9b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710678.011427:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a1b1f0bc/0xcbad34b281570aa2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbad34b281570a9b expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710678.011437:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a1b1f0bc/0xcbad34b281570aa2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281570a9b expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710678.011445:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a1b1f0bc, rc 0) 00000100:00100000:3.0:1790710678.011495:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000007bb9795c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+10:5825:x1877696176981376:12345-0@lo:101: Request processed in 130us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710678.011502:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790710678.011746:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002203b0f4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:5825:1877696176981376:0@lo:101: 00010000:00010000:2.0:1790710678.011762:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.146@tcp lock: 0000000088a37ce1/0xcbad34b281570a9b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570aa2 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710678.011770:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.146@tcp lock: 0000000088a37ce1/0xcbad34b281570a9b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbad34b281570aa2 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710678.012369:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000001d449bc pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:5825:1877696176981504:0@lo:256: 00000100:00100000:2.0:1790710678.012412:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710678.012433:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 000000002e5913ff going to sleep for 11 seconds 00000100:00100000:1.0:1790710678.015119:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176981504 00000100:00100000:1.0:1790710678.015158:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176981504 00000100:00100000:1.0:1790710678.015213:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790710678.015221:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000a0ae1e9e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+10:5825:x1877696176981504:12345-0@lo:256: 20000000:01000000:1.0:1790710678.015243:0:5838:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1790710678.015249:0:5838:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1790710678.015368:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000a0ae1e9e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+10:5825:x1877696176981504:12345-0@lo:256: Request processed in 148us (2955us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710678.015375:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790710678.018480:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000001d449bc pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:5825:1877696176981504:0@lo:256: 10000000:01000000:2.0:1790710678.019113:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.146@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790710678.019171:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: 0000000088a37ce1/0xcbad34b281570a9b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570aa2 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710678.019183:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.146@tcp lock: 0000000088a37ce1/0xcbad34b281570a9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570aa2 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790710678.019191:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c51c67ea000 from 1 10000000:01000000:2.0:1790710678.019194:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790710678.019242:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.146@tcp lock: 00000000cac26d35/0xcbad34b281570aa9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710678.019250:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.146@tcp lock: 00000000cac26d35/0xcbad34b281570aa9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710678.019259:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.146@tcp lock: 00000000cac26d35/0xcbad34b281570aa9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710678.019288:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000001d449bc pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:5825:1877696176981632:0@lo:101: 00000100:00100000:2.0:1790710678.019356:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710678.019391:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 000000002e5913ff going to sleep for 11 seconds 00000100:00100000:1.0:1790710678.022786:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176981632 00000100:00100000:1.0:1790710678.022802:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176981632 00000100:00100000:1.0:1790710678.022874:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790710678.022883:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000004f7a173b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+10:5825:x1877696176981632:12345-0@lo:101: 00010000:00010000:1.0:1790710678.022900:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790710678.022922:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f5d5eeb4/0xcbad34b281570ab0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbad34b281570aa9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710678.022947:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f5d5eeb4/0xcbad34b281570ab0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbad34b281570aa9 expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710678.022971:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f5d5eeb4/0xcbad34b281570ab0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281570aa9 expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710678.022991:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f5d5eeb4, rc 0) 00000100:00100000:1.0:1790710678.023067:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000004f7a173b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+11:5825:x1877696176981632:12345-0@lo:101: Request processed in 185us (3710us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710678.023073:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790710678.025074:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000001d449bc pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:5825:1877696176981632:0@lo:101: 00010000:00010000:2.0:1790710678.025100:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.146@tcp lock: 00000000cac26d35/0xcbad34b281570aa9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570ab0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710678.025111:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.146@tcp lock: 00000000cac26d35/0xcbad34b281570aa9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbad34b281570ab0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710678.025217:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000001d449bc pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:5825:1877696176981760:0@lo:501: 00000100:00100000:2.0:1790710678.025269:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710678.025314:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 000000002e5913ff going to sleep for 11 seconds 00010000:00010000:3.0:1790710678.026601:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790710678.026622:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176981760 00000100:00100000:3.0:1790710678.026631:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176981760 00000100:00100000:3.0:1790710678.026687:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790710678.026703:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000005c776586 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+11:5825:x1877696176981760:12345-0@lo:501: 00000100:00100000:3.0:1790710678.028699:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000005c776586 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+11:5825:x1877696176981760:12345-0@lo:501: Request processed in 1968us (3393us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710678.028713:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790710678.028866:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000001d449bc pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:5825:1877696176981760:0@lo:501: 00000100:00100000:0.0:1790710678.028942:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b17afa47 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:5825:1877696176981888:0@lo:503: 00000100:00100000:0.0:1790710678.028995:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710678.029033:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e775ccf2 going to sleep for 11 seconds 00000100:00100000:3.0:1790710678.029239:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176981888 00000100:00100000:3.0:1790710678.029246:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176981888 00000100:00100000:3.0:1790710678.029291:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790710678.029298:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000000caa7582 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+11:5825:x1877696176981888:12345-0@lo:503: 00000040:00080000:3.0:1790710678.029583:0:5837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790710678.029639:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000000caa7582 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+11:5825:x1877696176981888:12345-0@lo:503: Request processed in 341us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710678.029645:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790710678.029731:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b17afa47 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:5825:1877696176981888:0@lo:503: 00000040:00080000:3.0:1790710678.031724:0:5872:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1790710678.032538:0:5825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1790710678.032562:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790710678.032612:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: 00000000cac26d35/0xcbad34b281570aa9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570ab0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710678.032625:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.146@tcp lock: 00000000cac26d35/0xcbad34b281570aa9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570ab0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790710678.032676:0:5825:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1790710678.032679:0:5825:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c51c67ea000 10000000:01000000:2.0:1790710678.032682:0:5825:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c51c67ea000 10000000:01000000:2.0:1790710678.032686:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790710678.032691:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c51c67ea000 from 1 10000000:01000000:2.0:1790710678.032693:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790710678.032735:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.146@tcp lock: 00000000f1b88439/0xcbad34b281570ab7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710678.032744:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.146@tcp lock: 00000000f1b88439/0xcbad34b281570ab7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710678.032753:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.146@tcp lock: 00000000f1b88439/0xcbad34b281570ab7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710678.032786:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005ee0d287 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:5825:1877696176982016:0@lo:101: 00000100:00100000:2.0:1790710678.032850:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710678.032933:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 0000000021e5d520 going to sleep for 11 seconds 00000100:00100000:0.0:1790710678.033521:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176982016 00000100:00100000:0.0:1790710678.033530:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176982016 00000100:00100000:0.0:1790710678.033582:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790710678.033589:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000053c70076 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+11:5825:x1877696176982016:12345-0@lo:101: 00010000:00010000:0.0:1790710678.033603:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790710678.033618:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a2ef2055/0xcbad34b281570abe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbad34b281570ab7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710678.033640:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a2ef2055/0xcbad34b281570abe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbad34b281570ab7 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710678.033650:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a2ef2055/0xcbad34b281570abe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281570ab7 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710678.033673:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a2ef2055, rc 0) 00000100:00100000:0.0:1790710678.033776:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000053c70076 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+12:5825:x1877696176982016:12345-0@lo:101: Request processed in 176us (915us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710678.033783:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790710678.033901:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005ee0d287 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:5825:1877696176982016:0@lo:101: 00010000:00010000:2.0:1790710678.033915:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.146@tcp lock: 00000000f1b88439/0xcbad34b281570ab7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570abe expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710678.033923:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.146@tcp lock: 00000000f1b88439/0xcbad34b281570ab7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbad34b281570abe expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710678.033977:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005ee0d287 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:5825:1877696176982144:0@lo:501: 00000100:00100000:2.0:1790710678.034005:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710678.034078:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 0000000021e5d520 going to sleep for 11 seconds 00000100:00100000:3.0:1790710678.034537:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176982144 00000100:00100000:3.0:1790710678.034543:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176982144 00000100:00100000:3.0:1790710678.034582:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790710678.034588:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000e9ef2188 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+12:5825:x1877696176982144:12345-0@lo:501: 00000100:00100000:3.0:1790710678.037188:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000e9ef2188 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+12:5825:x1877696176982144:12345-0@lo:501: Request processed in 2588us (3171us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710678.037207:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790710678.039741:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005ee0d287 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:5825:1877696176982144:0@lo:501: 00000100:00100000:2.0:1790710678.039819:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005ee0d287 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:5825:1877696176982272:0@lo:503: 00000100:00100000:2.0:1790710678.039897:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710678.039938:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 0000000021e5d520 going to sleep for 11 seconds 00000100:00100000:0.0:1790710678.040010:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176982272 00000100:00100000:0.0:1790710678.040027:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176982272 00000100:00100000:0.0:1790710678.040091:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790710678.040099:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000001e8d94bf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+12:5825:x1877696176982272:12345-0@lo:503: 00000100:00100000:1.0:1790710678.047306:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000001e8d94bf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+12:5825:x1877696176982272:12345-0@lo:503: Request processed in 7200us (7401us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710678.047321:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790710678.047715:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005ee0d287 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:5825:1877696176982272:0@lo:503: 00000100:00100000:1.0:1790710678.050667:0:5873:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000436877e7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d27fc27-b651-404a-bd8c-b798806fb18a:5873:1877696176982400:0@lo:502: 00000100:00100000:1.0:1790710678.050759:0:5873:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710678.050827:0:5873:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d41dc405 going to sleep for 11 seconds 00000100:00100000:3.0:1790710678.050895:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176982400 00000100:00100000:3.0:1790710678.050904:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176982400 00000100:00100000:3.0:1790710678.050955:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790710678.050963:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000032e9492b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+12:5873:x1877696176982400:12345-0@lo:502: 00000100:00100000:3.0:1790710678.051320:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000032e9492b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+12:5873:x1877696176982400:12345-0@lo:502: Request processed in 358us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710678.051328:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790710678.051470:0:5873:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000436877e7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d27fc27-b651-404a-bd8c-b798806fb18a:5873:1877696176982400:0@lo:502: 00000020:01000004:2.0:1790710678.051532:0:5873:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1790710678.051551:0:5873:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (0000000031a23c4d) 00000020:00000080:2.0:1790710678.051568:0:5873:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1790710678.051647:0:5873:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000bd211d4f from lustre-MDT0000, refs=4 00000020:01000004:2.0:1790710678.051651:0:5873:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000bd211d4f from lustre-MDT0000, refs=4 00000020:01000004:2.0:1790710678.051654:0:5873:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000bd211d4f 4 00010000:00080000:2.0:1790710678.051684:0:5873:0:(ldlm_lib.c:102:import_set_conn()) imp 000000004a3a3d8f@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.146@tcp at head 00010000:00010000:2.0:1790710678.055681:0:5873:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1790710678.056042:0:5873:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1790710678.056088:0:5873:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1790710678.056100:0:5873:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xcbad34b281570acc 00000100:00080000:2.0:1790710678.056110:0:5873:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790710678.056119:0:5873:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000004a3a3d8f using connection 192.168.206.146@tcp/0@lo 00000100:00100000:2.0:1790710678.056200:0:5873:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000006fd309ec x1877696176982528/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790710678.056230:0:5873:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1790710678.056296:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006fd309ec pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877696176982528:0@lo:38: 00000100:00100000:3.0:1790710678.056376:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710678.056497:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176982528 00000100:00100000:2.0:1790710678.056505:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176982528 00000100:00100000:2.0:1790710678.056537:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790710678.056540:0:5873:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000093808629 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d27fc27-b651-404a-bd8c-b798806fb18a:5873:1877696176982656:0@lo:502: 00000100:00100000:2.0:1790710678.056546:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000c5812606 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3308:x1877696176982528:12345-0@lo:38: 00000100:00100000:3.0:1790710678.056585:0:5873:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710678.056612:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000c5812606 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3308:x1877696176982528:12345-0@lo:38: Request processed in 67us (236us total) trans 0 rc -11/-11 00000100:00100000:3.0:1790710678.056616:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176982656 00000100:00100000:3.0:1790710678.056621:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176982656 00000100:00100000:2.0:1790710678.056621:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790710678.056656:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790710678.056664:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000486a5214 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+12:5873:x1877696176982656:12345-0@lo:502: 00000100:00100000:3.0:1790710678.056855:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000486a5214 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+12:5873:x1877696176982656:12345-0@lo:502: Request processed in 192us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710678.056861:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790710678.056909:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790710678.056917:0:3308:0:(import.c:65:import_set_state_nolock()) 000000004a3a3d8f lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790710678.056921:0:3308:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1790710678.056924:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006fd309ec pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877696176982528:0@lo:38: 00000100:00100000:2.0:1790710678.056968:0:5873:0:(client.c:2716:ptlrpc_set_wait()) set 0000000059379d6d going to sleep for 11 seconds 00000100:00100000:2.0:1790710678.056984:0:5873:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000093808629 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d27fc27-b651-404a-bd8c-b798806fb18a:5873:1877696176982656:0@lo:502: 00000040:00080000:2.0:1790710678.057006:0:5873:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:3.0:1790710678.057222:0:5825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:3.0:1790710678.057257:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790710678.057272:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: 00000000f1b88439/0xcbad34b281570ab7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570abe expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710678.057283:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.146@tcp lock: 00000000f1b88439/0xcbad34b281570ab7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570abe expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1790710678.057324:0:5825:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1790710678.057326:0:5825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790710678.057328:0:5825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790710678.057329:0:5825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790710678.057330:0:5825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790710678.057332:0:5825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790710678.057333:0:5825:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790710678.057335:0:5825:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790710678.057336:0:5825:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790710678.057337:0:5825:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790710678.057339:0:5825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790710678.057340:0:5825:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790710678.057343:0:5825:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:3.0:1790710678.057346:0:5825:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790710678.057347:0:5825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790710678.057348:0:5825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790710678.057349:0:5825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790710678.057350:0:5825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790710678.057351:0:5825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790710678.057352:0:5825:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790710678.057353:0:5825:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790710678.057354:0:5825:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790710678.057355:0:5825:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790710678.057361:0:5825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790710678.057362:0:5825:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790710678.057377:0:5825:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1790710678.057386:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c4e8fe6c pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:5825:1877696176982784:0@lo:253: 00000100:00100000:3.0:1790710678.057421:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710678.057448:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c36fd462 going to sleep for 11 seconds 00000100:00100000:1.0:1790710678.057826:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176982784 00000100:00100000:1.0:1790710678.057832:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176982784 00000100:00100000:1.0:1790710678.057872:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790710678.057880:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000991de70a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+12:5825:x1877696176982784:12345-0@lo:253: 20000000:01000000:1.0:1790710678.057900:0:5838:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1790710678.057912:0:5838:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1790710678.146056:0:5838:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1790710678.146088:0:5838:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1790710678.146622:0:5861:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1790710678.146628:0:5861:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1790710678.146646:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000c010bb68/0xcbad34b281570ad3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710678.146664:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000a1b1f0bc/0xcbad34b281570aa2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281570a9b expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710678.146671:0:5861:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000c010bb68/0xcbad34b281570ad3 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710678.146721:0:5861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000a1b1f0bc/0xcbad34b281570aa2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbad34b281570a9b expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710678.146736:0:5861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000a1b1f0bc/0xcbad34b281570aa2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbad34b281570a9b expref: 12 pid: 5837 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710678.146748:0:5861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000019d8dc99 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5861:1877696176982912:0@lo:104: 00000100:00100000:1.0:1790710678.146807:0:5861:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710678.146862:0:5861:0:(client.c:2716:ptlrpc_set_wait()) set 000000003b51a9cb going to sleep for 11 seconds 00000100:00100000:2.0:1790710678.147515:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176982912 00000100:00100000:2.0:1790710678.147525:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176982912 00000100:00100000:2.0:1790710678.147574:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790710678.147582:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000a4d52d21 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5d27fc27-b651-404a-bd8c-b798806fb18a+3:5861:x1877696176982912:12345-0@lo:104: 00010000:00010000:2.0:1790710678.147600:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.146@tcp lock: 0000000088a37ce1/0xcbad34b281570a9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbad34b281570aa2 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710678.147661:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790710678.147667:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000a4d52d21 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5d27fc27-b651-404a-bd8c-b798806fb18a+3:5861:x1877696176982912:12345-0@lo:104: Request processed in 87us (861us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710678.147674:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1790710678.148255:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790710678.148262:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.146@tcp lock: 0000000088a37ce1/0xcbad34b281570a9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbad34b281570aa2 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710678.148270:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000088a37ce1 already unused, calling callback (000000009fbfdf7d) 10000000:00010000:3.0:1790710678.148273:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.146@tcp lock: 0000000088a37ce1/0xcbad34b281570a9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbad34b281570aa2 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710678.148281:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.146@tcp lock: 0000000088a37ce1/0xcbad34b281570a9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbad34b281570aa2 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790710678.148287:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.146@tcp lock: 0000000088a37ce1/0xcbad34b281570a9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbad34b281570aa2 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790710678.148293:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1790710678.148337:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.146@tcp lock: 0000000088a37ce1/0xcbad34b281570a9b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281570aa2 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710678.148344:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790710678.148361:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.146@tcp lock: 0000000088a37ce1/0xcbad34b281570a9b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281570aa2 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710678.148366:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.146@tcp lock: 0000000088a37ce1/0xcbad34b281570a9b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281570aa2 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710678.148395:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790710678.148397:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790710678.148398:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790710678.148449:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004766d1f3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d27fc27-b651-404a-bd8c-b798806fb18a:3310:1877696176983040:0@lo:103: 00000100:00100000:3.0:1790710678.148486:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710678.148537:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176983040 00000100:00100000:3.0:1790710678.148542:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176983040 00010000:00010000:3.0:1790710678.148560:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000a1b1f0bc/0xcbad34b281570aa2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbad34b281570a9b expref: 13 pid: 5837 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710678.148582:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790710678.148588:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000c91a8530 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d27fc27-b651-404a-bd8c-b798806fb18a+13:3310:x1877696176983040:12345-0@lo:103: 00010000:00010000:3.0:1790710678.148598:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790710678.148603:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000a1b1f0bc/0xcbad34b281570aa2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbad34b281570a9b expref: 13 pid: 5837 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710678.148612:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000a1b1f0bc/0xcbad34b281570aa2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbad34b281570a9b expref: 13 pid: 5837 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710678.148626:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000c010bb68/0xcbad34b281570ad3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710678.148633:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c010bb68/0xcbad34b281570ad3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1790710678.148646:0:5829:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002018839s 00010000:00010000:3.0:1790710678.148649:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c010bb68/0xcbad34b281570ad3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710678.148664:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c010bb68/0xcbad34b281570ad3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710678.148671:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000c010bb68/0xcbad34b281570ad3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710678.148676:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000c010bb68/0xcbad34b281570ad3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710678.148682:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c010bb68 already unused, calling callback (00000000ed8a1e61) 00010000:00010000:3.0:1790710678.148685:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000c010bb68/0xcbad34b281570ad3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710678.148691:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000c010bb68/0xcbad34b281570ad3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710678.148698:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000c010bb68/0xcbad34b281570ad3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710678.148708:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790710678.148737:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000c91a8530 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d27fc27-b651-404a-bd8c-b798806fb18a+13:3310:x1877696176983040:12345-0@lo:103: Request processed in 150us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710678.148744:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790710678.148782:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004766d1f3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d27fc27-b651-404a-bd8c-b798806fb18a:3310:1877696176983040:0@lo:103: 00010000:00010000:3.0:1790710678.148811:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a1b1f0bc/0xcbad34b281570aa2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbad34b281570a9b expref: 12 pid: 5837 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710678.148820:0:5861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000019d8dc99 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5861:1877696176982912:0@lo:104: 00010000:00010000:3.0:1790710678.148831:0:5861:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000c010bb68/0xcbad34b281570ad3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710678.148844:0:5861:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000c010bb68/0xcbad34b281570ad3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710678.148849:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000c010bb68/0xcbad34b281570ad3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710678.148853:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c010bb68/0xcbad34b281570ad3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710678.162549:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000991de70a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+11:5825:x1877696176982784:12345-0@lo:253: Request processed in 104662us (105119us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710678.162565:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790710678.162704:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c4e8fe6c pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:5825:1877696176982784:0@lo:253: 10000000:01000000:0.0:1790710678.162719:0:5825:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1790710678.162722:0:5825:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790710678.162724:0:5825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1790710678.162725:0:5825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790710678.162726:0:5825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790710678.162727:0:5825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790710678.162728:0:5825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790710678.162730:0:5825:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790710678.162731:0:5825:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1790710678.162732:0:5825:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790710678.162733:0:5825:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790710678.162734:0:5825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790710678.162735:0:5825:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1790710678.162753:0:5825:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1790710678.173967:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1790710678.174392:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1790710678.174620:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1790710678.174786:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1790710678.174981:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1790710678.180695:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1790710678.181488:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1790710678.181672:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1790710678.181872:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1790710678.182042:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1790710678.182300:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1790710678.182494:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:0.0:1790710678.276088:0:5825:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1790710678.342528:0:5825:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1790710678.343276:0:5878:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1790710678.343280:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1790710678.343710:0:5879:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1790710678.349956:0:5825:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1790710678.351020:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1790710678.351641:0:5825:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1790710678.351651:0:5825:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1790710678.351860:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790710678.352874:0:5825:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1790710678.353441:0:5825:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1790710678.353472:0:5825:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1790710678.353704:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1790710678.353885:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:3.0:1790710678.368182:0:5825:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1790710678.368361:0:5825:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1790710678.368510:0:5825:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1790710678.368675:0:5825:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1790710678.368814:0:5825:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1790710678.374902:0:5825:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1790710678.375257:0:5825:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1790710678.377697:0:5825:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1790710678.377949:0:5825:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1790710678.378284:0:5825:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1790710678.378527:0:5825:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1790710678.378678:0:5825:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1790710678.378825:0:5825:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1790710678.381550:0:5825:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1790710678.381871:0:5825:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1790710678.390672:0:5825:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1790710678.391072:0:5825:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1790710678.391263:0:5825:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1790710678.391426:0:5825:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1790710678.391588:0:5825:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1790710678.391741:0:5825:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1790710678.391893:0:5825:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1790710678.392031:0:5825:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1790710678.392207:0:5825:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1790710678.392376:0:5825:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1790710678.392515:0:5825:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1790710678.392655:0:5825:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1790710678.392797:0:5825:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1790710678.392965:0:5825:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1790710678.393094:0:5825:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1790710678.411862:0:5825:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1790710678.412111:0:5825:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1790710678.412344:0:5825:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:1.0:1790710678.445722:0:5879:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:1.0:1790710678.505469:0:5825:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1790710678.505504:0:5825:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb1c781967988 00100000:10000000:1.0:1790710678.505512:0:5825:0:(lfsck_lib.c:3084:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1790710678.507476:0:5825:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1790710678.507491:0:5825:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.146@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1790710678.507503:0:5825:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1790710678.507527:0:5825:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:2.0:1790710678.570294:0:5879:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1790710678.570366:0:5879:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1790710678.570370:0:5879:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1790710679.047307:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790710680.078955:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710681.095639:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790710682.122325:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790710683.143478:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790710683.399298:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1790710683.399308:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1790710683.399310:0:37:0:(import.c:65:import_set_state_nolock()) 000000004a3a3d8f lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790710683.399326:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000004a3a3d8f using connection 192.168.206.146@tcp/0@lo 00000100:00100000:1.0:1790710683.399347:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000f7477de0 x1877696176983296/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790710683.399396:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f7477de0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877696176983296:0@lo:38: 00000100:00100000:1.0:1790710683.399527:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710683.399693:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790710683.399706:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002c95d231 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d27fc27-b651-404a-bd8c-b798806fb18a:3312:1877696176983168:0@lo:400: 00000100:00100000:1.0:1790710683.399737:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710683.399771:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176983168 00000100:00100000:1.0:1790710683.399778:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176983168 00000100:00100000:1.0:1790710683.399830:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790710683.399839:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000019279dd4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+11:3312:x1877696176983168:12345-0@lo:400: 00000100:00100000:1.0:1790710683.399888:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000019279dd4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+11:3312:x1877696176983168:12345-0@lo:400: Request processed in 51us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710683.399895:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790710683.399940:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002c95d231 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d27fc27-b651-404a-bd8c-b798806fb18a:3312:1877696176983168:0@lo:400: 00000100:00100000:2.0:1790710683.404367:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176983296 00000100:00100000:2.0:1790710683.404386:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176983296 00000100:00100000:2.0:1790710683.404436:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790710683.404443:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000000d920740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3308:x1877696176983296:12345-0@lo:38: 00010000:00080000:2.0:1790710683.404482:0:5847:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 160 last 0 00000020:00000080:2.0:1790710683.404535:0:5847:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xcbad34b281570ada 00000004:00100000:2.0:1790710683.404599:0:5847:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1790710683.404739:0:5847:0:(import.c:65:import_set_state_nolock()) 0000000046e116ad : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790710683.404839:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000000d920740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1877696176983296:12345-0@lo:38: Request processed in 395us (5324us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710683.404846:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1790710683.404895:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000f7477de0 x1877696176983296/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790710693 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790710683.404923:0:3308:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1790710683.404930:0:3308:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1790710683.404934:0:3308:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1790710683.404937:0:3308:0:(import.c:65:import_set_state_nolock()) 000000004a3a3d8f lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1790710683.404942:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f7477de0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877696176983296:0@lo:38: 00000001:02000400:0.0:1790710683.782158:0:6121:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg646-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:2.0:1790710683.914005:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1790710683.914010:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c51c67ea000 from 3 10000000:01000000:2.0:1790710683.914014:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790710683.914055:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.146@tcp lock: 000000008871b5d8/0xcbad34b281570ae1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710683.914067:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.146@tcp lock: 000000008871b5d8/0xcbad34b281570ae1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710683.914077:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.146@tcp lock: 000000008871b5d8/0xcbad34b281570ae1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710683.914108:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e6d44a49 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696176983424:0@lo:101: 00000100:00100000:2.0:1790710683.914200:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710683.914238:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set 00000000096c910f going to sleep for 11 seconds 00000100:00100000:0.0:1790710683.916827:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176983424 00000100:00100000:0.0:1790710683.916838:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176983424 00000100:00100000:0.0:1790710683.916925:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790710683.916934:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000009feee35e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+11:5842:x1877696176983424:12345-0@lo:101: 00010000:00010000:0.0:1790710683.916951:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790710683.916973:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005d32b55d/0xcbad34b281570ae8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbad34b281570ae1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710683.916996:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005d32b55d/0xcbad34b281570ae8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbad34b281570ae1 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710683.917006:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005d32b55d/0xcbad34b281570ae8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281570ae1 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710683.917014:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005d32b55d, rc 0) 00000100:00100000:0.0:1790710683.917084:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000009feee35e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+12:5842:x1877696176983424:12345-0@lo:101: Request processed in 151us (2885us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710683.917091:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790710683.929440:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e6d44a49 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696176983424:0@lo:101: 00010000:00010000:2.0:1790710683.929469:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.146@tcp lock: 000000008871b5d8/0xcbad34b281570ae1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570ae8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710683.929481:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.146@tcp lock: 000000008871b5d8/0xcbad34b281570ae1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbad34b281570ae8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710683.929545:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e6d44a49 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696176983552:0@lo:256: 00000100:00100000:2.0:1790710683.929612:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710683.929645:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set 00000000096c910f going to sleep for 11 seconds 00000100:00100000:1.0:1790710683.930171:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176983552 00000100:00100000:1.0:1790710683.930179:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176983552 00000100:00100000:1.0:1790710683.930224:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790710683.930231:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000058dab768 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+12:5842:x1877696176983552:12345-0@lo:256: 20000000:01000000:1.0:1790710683.930250:0:5837:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1790710683.930265:0:5837:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1790710683.930268:0:5837:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1790710683.930371:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000058dab768 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+12:5842:x1877696176983552:12345-0@lo:256: Request processed in 140us (759us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710683.930378:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790710683.930425:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e6d44a49 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696176983552:0@lo:256: 10000000:01000000:1.0:1790710683.930464:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.146@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790710683.930471:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: 000000008871b5d8/0xcbad34b281570ae1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570ae8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710683.930479:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.146@tcp lock: 000000008871b5d8/0xcbad34b281570ae1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570ae8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710684.167280:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790710685.191447:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790710686.216202:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710687.239860:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790710688.263373:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790710688.520476:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790710688.520540:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c6be9081 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877696176983808:0@lo:400: 00000100:00100000:3.0:1790710688.520605:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710688.521102:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790710688.521116:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004766d1f3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d27fc27-b651-404a-bd8c-b798806fb18a:3311:1877696176983680:0@lo:400: 00000100:00100000:2.0:1790710688.521207:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710688.521357:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176983680 00000100:00100000:3.0:1790710688.521365:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176983680 00000100:00100000:3.0:1790710688.521415:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1790710688.521423:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000be08977f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+12:3311:x1877696176983680:12345-0@lo:400: 00000100:00100000:3.0:1790710688.521471:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000be08977f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+12:3311:x1877696176983680:12345-0@lo:400: Request processed in 49us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710688.521477:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176983808 00000100:00100000:3.0:1790710688.521479:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790710688.521550:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176983808 00000100:00100000:2.0:1790710688.521567:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004766d1f3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d27fc27-b651-404a-bd8c-b798806fb18a:3311:1877696176983680:0@lo:400: 00000100:00100000:1.0:1790710688.521587:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790710688.521593:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000004b41d415 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1877696176983808:12345-0@lo:400: 00000100:00100000:1.0:1790710688.521645:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000004b41d415 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1877696176983808:12345-0@lo:400: Request processed in 51us (1039us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710688.521651:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1790710688.521671:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000c6be9081 x1877696176983808/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790710704 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790710688.521683:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c6be9081 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877696176983808:0@lo:400: 00000020:00000080:1.0:1790710689.043265:0:6324:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcd76b7130 20000000:00000080:1.0:1790710689.043282:0:6324:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c51c8ee6400 uarg=0000000000000000 20000000:01000000:1.0:1790710689.043320:0:6324:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1790710689.043326:0:6324:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1790710689.043331:0:6324:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1790710689.043549:0:6324:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1790710689.043559:0:6324:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1790710689.046818:0:6324:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790710689.047303:0:6324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1790710689.047363:0:6324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1790710689.047419:0:6324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1790710689.047437:0:6324:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1790710689.047454:0:6324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000999909ac/0xcbad34b281570aef lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710689.047471:0:6324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f5d5eeb4/0xcbad34b281570ab0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281570aa9 expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710689.047479:0:6324:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000999909ac/0xcbad34b281570aef lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710689.047520:0:6324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000f5d5eeb4/0xcbad34b281570ab0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbad34b281570aa9 expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710689.047532:0:6324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000f5d5eeb4/0xcbad34b281570ab0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbad34b281570aa9 expref: 11 pid: 5838 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710689.047545:0:6324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002c95d231 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6324:1877696176983936:0@lo:104: 00000100:00100000:1.0:1790710689.047601:0:6324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710689.047698:0:6324:0:(client.c:2716:ptlrpc_set_wait()) set 0000000030f740a9 going to sleep for 11 seconds 00000100:00100000:0.0:1790710689.047740:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176983936 00000100:00100000:0.0:1790710689.047749:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176983936 00000100:00100000:0.0:1790710689.047798:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790710689.047806:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000bc456eab pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5d27fc27-b651-404a-bd8c-b798806fb18a+3:6324:x1877696176983936:12345-0@lo:104: 00010000:00010000:0.0:1790710689.047817:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.146@tcp lock: 00000000cac26d35/0xcbad34b281570aa9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbad34b281570ab0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710689.047936:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790710689.047942:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000bc456eab pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5d27fc27-b651-404a-bd8c-b798806fb18a+3:6324:x1877696176983936:12345-0@lo:104: Request processed in 138us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710689.047950:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1790710689.047959:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790710689.047976:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.146@tcp lock: 00000000cac26d35/0xcbad34b281570aa9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbad34b281570ab0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710689.047985:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000cac26d35 already unused, calling callback (000000009fbfdf7d) 10000000:00010000:3.0:1790710689.047988:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.146@tcp lock: 00000000cac26d35/0xcbad34b281570aa9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbad34b281570ab0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710689.047996:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.146@tcp lock: 00000000cac26d35/0xcbad34b281570aa9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbad34b281570ab0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790710689.048009:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.146@tcp lock: 00000000cac26d35/0xcbad34b281570aa9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbad34b281570ab0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790710689.048014:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790710689.048051:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.146@tcp lock: 00000000cac26d35/0xcbad34b281570aa9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281570ab0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710689.048057:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790710689.048093:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.146@tcp lock: 00000000cac26d35/0xcbad34b281570aa9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281570ab0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710689.048100:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.146@tcp lock: 00000000cac26d35/0xcbad34b281570aa9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281570ab0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710689.048114:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790710689.048115:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790710689.048117:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790710689.048123:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790710689.048157:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c527c862 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d27fc27-b651-404a-bd8c-b798806fb18a:3309:1877696176984064:0@lo:103: 00000100:00100000:3.0:1790710689.048190:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710689.048221:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176984064 00000100:00100000:3.0:1790710689.048225:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176984064 00010000:00010000:3.0:1790710689.048245:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000f5d5eeb4/0xcbad34b281570ab0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbad34b281570aa9 expref: 12 pid: 5838 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710689.048270:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790710689.048277:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000046ca2684 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d27fc27-b651-404a-bd8c-b798806fb18a+12:3309:x1877696176984064:12345-0@lo:103: 00010000:00010000:3.0:1790710689.048287:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790710689.048291:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000f5d5eeb4/0xcbad34b281570ab0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbad34b281570aa9 expref: 12 pid: 5838 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710689.048301:0:6324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002c95d231 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6324:1877696176983936:0@lo:104: 00010000:00010000:3.0:1790710689.048314:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000f5d5eeb4/0xcbad34b281570ab0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbad34b281570aa9 expref: 12 pid: 5838 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710689.048325:0:6324:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000999909ac/0xcbad34b281570aef lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710689.048330:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f5d5eeb4/0xcbad34b281570ab0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbad34b281570aa9 expref: 12 pid: 5838 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710689.048347:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000999909ac/0xcbad34b281570aef lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710689.048354:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000999909ac/0xcbad34b281570aef lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710689.048367:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000999909ac/0xcbad34b281570aef lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710689.048374:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000999909ac/0xcbad34b281570aef lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710689.048380:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000999909ac/0xcbad34b281570aef lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710689.048385:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000999909ac/0xcbad34b281570aef lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710689.048390:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000999909ac already unused, calling callback (00000000ed8a1e61) 00010000:00010000:3.0:1790710689.048393:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000999909ac/0xcbad34b281570aef lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710689.048400:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000999909ac/0xcbad34b281570aef lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710689.048497:0:6324:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000999909ac/0xcbad34b281570aef lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710689.048498:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000999909ac/0xcbad34b281570aef lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710689.048517:0:6324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000999909ac/0xcbad34b281570aef lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710689.048522:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790710689.048527:0:6324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000999909ac/0xcbad34b281570aef lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710689.048676:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000046ca2684 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d27fc27-b651-404a-bd8c-b798806fb18a+11:3309:x1877696176984064:12345-0@lo:103: Request processed in 399us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710689.048683:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790710689.048882:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c527c862 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d27fc27-b651-404a-bd8c-b798806fb18a:3309:1877696176984064:0@lo:103: 00010000:00010000:1.0:1790710689.291866:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710690.316288:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710691.336748:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710692.360386:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790710693.391097:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790710693.643599:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008bcbdaf4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d27fc27-b651-404a-bd8c-b798806fb18a:3311:1877696176984192:0@lo:400: 00000100:00100000:2.0:1790710693.643670:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710693.643722:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790710693.643728:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fdc35f3c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1877696176984320:0@lo:400: 00000100:00100000:2.0:1790710693.643754:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710693.643790:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176984320 00000100:00100000:2.0:1790710693.643798:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176984320 00000100:00100000:2.0:1790710693.643837:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790710693.643844:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000098a94ab1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1877696176984320:12345-0@lo:400: 00000100:00100000:2.0:1790710693.643891:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000098a94ab1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1877696176984320:12345-0@lo:400: Request processed in 47us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710693.643913:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1790710693.643962:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000fdc35f3c x1877696176984320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790710709 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790710693.643986:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fdc35f3c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1877696176984320:0@lo:400: 00000100:00100000:3.0:1790710693.644168:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176984192 00000100:00100000:3.0:1790710693.644173:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176984192 00000100:00100000:3.0:1790710693.644199:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790710693.644205:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000003fe23ae8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+11:3311:x1877696176984192:12345-0@lo:400: 00000100:00100000:3.0:1790710693.644239:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000003fe23ae8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+11:3311:x1877696176984192:12345-0@lo:400: Request processed in 35us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710693.644245:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790710693.644501:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008bcbdaf4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d27fc27-b651-404a-bd8c-b798806fb18a:3311:1877696176984192:0@lo:400: 10000000:01000000:1.0:1790710693.645038:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790710693.645042:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c51c67ea000 from 1 10000000:01000000:1.0:1790710693.645055:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790710693.645085:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.146@tcp lock: 000000004c6f26ee/0xcbad34b281570af6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710693.645118:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.146@tcp lock: 000000004c6f26ee/0xcbad34b281570af6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710693.645151:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.146@tcp lock: 000000004c6f26ee/0xcbad34b281570af6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710693.645166:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002c95d231 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696176984448:0@lo:101: 00000100:00100000:1.0:1790710693.645199:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710693.645223:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set 00000000718a64d0 going to sleep for 11 seconds 00000100:00100000:2.0:1790710693.645610:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176984448 00000100:00100000:2.0:1790710693.645617:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176984448 00000100:00100000:2.0:1790710693.645653:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790710693.645660:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000946e738a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+11:5842:x1877696176984448:12345-0@lo:101: 00010000:00010000:2.0:1790710693.645670:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790710693.645682:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b5746385/0xcbad34b281570afd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbad34b281570af6 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710693.645702:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b5746385/0xcbad34b281570afd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbad34b281570af6 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710693.645712:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b5746385/0xcbad34b281570afd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281570af6 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710693.645720:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b5746385, rc 0) 00000100:00100000:2.0:1790710693.645753:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000946e738a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+12:5842:x1877696176984448:12345-0@lo:101: Request processed in 94us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710693.645759:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790710693.646480:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002c95d231 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696176984448:0@lo:101: 00010000:00010000:1.0:1790710693.646495:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.146@tcp lock: 000000004c6f26ee/0xcbad34b281570af6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570afd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710693.646504:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.146@tcp lock: 000000004c6f26ee/0xcbad34b281570af6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbad34b281570afd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710693.646558:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002c95d231 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696176984576:0@lo:501: 00000100:00100000:1.0:1790710693.650397:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710693.650442:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set 00000000718a64d0 going to sleep for 11 seconds 00000100:00100000:1.0:1790710693.650470:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176984576 00000100:00100000:1.0:1790710693.650478:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176984576 00000100:00100000:1.0:1790710693.650522:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790710693.650530:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000005694770d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+12:5842:x1877696176984576:12345-0@lo:501: 00000100:00100000:1.0:1790710693.650777:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000005694770d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+12:5842:x1877696176984576:12345-0@lo:501: Request processed in 248us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710693.650785:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790710693.650842:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002c95d231 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696176984576:0@lo:501: 00000100:00100000:1.0:1790710693.650883:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002c95d231 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696176984704:0@lo:503: 00000100:00100000:1.0:1790710693.651506:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710693.651523:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set 00000000718a64d0 going to sleep for 11 seconds 00000100:00100000:2.0:1790710693.655041:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176984704 00000100:00100000:2.0:1790710693.655065:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176984704 00000100:00100000:2.0:1790710693.655118:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790710693.655150:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000f5ddced5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+12:5842:x1877696176984704:12345-0@lo:503: 00000100:00100000:2.0:1790710693.655347:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000f5ddced5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+12:5842:x1877696176984704:12345-0@lo:503: Request processed in 222us (3841us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710693.655363:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1790710693.655474:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002c95d231 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696176984704:0@lo:503: 00000100:00100000:1.0:1790710693.656450:0:6611:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002c95d231 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d27fc27-b651-404a-bd8c-b798806fb18a:6611:1877696176984832:0@lo:502: 00000100:00100000:1.0:1790710693.656505:0:6611:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710693.656573:0:6611:0:(client.c:2716:ptlrpc_set_wait()) set 00000000127eaadc going to sleep for 11 seconds 00000100:00100000:2.0:1790710693.656604:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176984832 00000100:00100000:2.0:1790710693.656609:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176984832 00000100:00100000:2.0:1790710693.656679:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790710693.656687:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000013841c3e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+12:6611:x1877696176984832:12345-0@lo:502: 00000100:00100000:2.0:1790710693.656833:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000013841c3e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+12:6611:x1877696176984832:12345-0@lo:502: Request processed in 147us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710693.656841:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1790710693.656906:0:6611:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002c95d231 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d27fc27-b651-404a-bd8c-b798806fb18a:6611:1877696176984832:0@lo:502: 00000020:01000000:1.0:1790710693.656928:0:6611:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790710693.656937:0:6611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790710693.656939:0:6611:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1790710693.656949:0:6611:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c51c67ea000 00000020:00000080:1.0:1790710693.656952:0:6611:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1790710693.656988:0:6611:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c812e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d27fc27-b651-404a-bd8c-b798806fb18a:6611:1877696176984960:0@lo:502: 00000100:00100000:1.0:1790710693.657019:0:6611:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710693.657176:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176984960 00000100:00100000:3.0:1790710693.657181:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176984960 00000100:00100000:3.0:1790710693.657201:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790710693.657206:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ee78b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+12:6611:x1877696176984960:12345-0@lo:502: 00000100:00100000:3.0:1790710693.657305:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ee78b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+12:6611:x1877696176984960:12345-0@lo:502: Request processed in 97us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710693.657312:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790710693.657472:0:6611:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51d03cfd80 going to sleep for 11 seconds 00000100:00100000:1.0:1790710693.657486:0:6611:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c812e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d27fc27-b651-404a-bd8c-b798806fb18a:6611:1877696176984960:0@lo:502: 00000020:01000000:1.0:1790710693.657504:0:6611:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790710693.657508:0:6611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790710693.657510:0:6611:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1790710693.657514:0:6611:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1790710693.657661:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1790710693.657679:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790710693.657688:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c1644a00/0xcbad34b281570af6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570afd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710693.657698:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.146@tcp lock: ffff9c51c1644a00/0xcbad34b281570af6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570afd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710694.415735:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790710695.431561:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1790710695.509398:0:6693:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1790710695.509402:0:6693:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1790710695.509512:0:6693:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c51f444d000 00000020:01000004:0.0:1790710695.509528:0:6693:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1790710695.509539:0:6693:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1790710695.509564:0:6693:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9c51fa0e0000) 00000020:00000080:0.0:1790710695.509580:0:6693:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1790710695.526005:0:6693:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1790710695.526644:0:6693:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1790710695.542776:0:6693:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1790710695.546508:0:6693:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1790710695.546540:0:6693:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1790710695.546594:0:6693:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1790710695.546622:0:6693:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1790710695.546919:0:6693:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1790710695.546929:0:6693:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:0.0:1790710695.546938:0:6693:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xcbad34b281570b0b 00000020:01000004:0.0:1790710695.546946:0:6693:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:0.0:1790710695.546964:0:6693:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.146@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1790710695.546967:0:6693:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.146@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1790710695.546972:0:6693:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1790710695.546976:0:6693:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1790710695.546992:0:6693:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9c51fa0e19c0) 00000020:00000080:0.0:1790710695.547003:0:6693:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:0.0:1790710695.548174:0:6693:0:(service.c:173:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790710695.550373:0:6693:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1790710695.550381:0:6693:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1790710695.553866:0:6693:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1790710695.553879:0:6693:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1790710695.554962:0:6693:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1790710695.554972:0:6693:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1790710695.558106:0:6693:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790710695.558475:0:6693:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1790710695.558481:0:6693:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1790710695.560327:0:6693:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1790710695.560337:0:6693:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1790710695.576488:0:6693:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790710695.576878:0:6693:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1790710695.576884:0:6693:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1790710695.578623:0:6693:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1790710695.578634:0:6693:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1790710695.580287:0:6693:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1790710695.580300:0:6693:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1790710695.584477:0:6693:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790710695.584668:0:6693:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1790710695.584675:0:6693:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1790710695.585388:0:6693:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1790710695.585396:0:6693:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1790710695.631283:0:6693:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790710695.631488:0:6693:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1790710695.631495:0:6693:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1790710695.632601:0:6693:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1790710695.632638:0:6693:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1790710695.636212:0:6693:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1790710695.636248:0:6693:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1790710695.636253:0:6693:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.146@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1790710695.655691:0:6693:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.146@tcp ctxt 0 is initialized 00000020:01000004:2.0:1790710695.655725:0:6693:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.146@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1790710695.655729:0:6693:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1790710695.655730:0:6693:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790710695.655732:0:6693:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790710695.655733:0:6693:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790710695.655734:0:6693:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790710695.655736:0:6693:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790710695.655737:0:6693:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790710695.655738:0:6693:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790710695.655740:0:6693:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790710695.655741:0:6693:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790710695.655743:0:6693:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790710695.655746:0:6693:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1790710695.655748:0:6693:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790710695.655749:0:6693:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790710695.655751:0:6693:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790710695.655752:0:6693:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790710695.655753:0:6693:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790710695.655754:0:6693:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790710695.655755:0:6693:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790710695.655756:0:6693:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790710695.655757:0:6693:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790710695.655758:0:6693:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790710695.655759:0:6693:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790710695.655789:0:6693:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1790710695.655806:0:6693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c8e8f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:6693:1877696176985088:0@lo:253: 00000100:00100000:2.0:1790710695.655945:0:6693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710695.656053:0:6693:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c7d4d000 going to sleep for 11 seconds 00000100:00100000:3.0:1790710695.656292:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176985088 00000100:00100000:3.0:1790710695.656299:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176985088 00000100:00100000:3.0:1790710695.656378:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790710695.656388:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ee78a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+12:6693:x1877696176985088:12345-0@lo:253: 20000000:01000000:3.0:1790710695.656416:0:5838:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1790710695.656420:0:5838:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1790710695.656425:0:5838:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1790710695.656429:0:5838:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1790710695.657378:0:5838:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790710695.657575:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1790710695.657587:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1790710695.657622:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:3.0:1790710695.657629:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1790710695.657657:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:3.0:1790710695.657706:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:3.0:1790710695.658480:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1790710695.658500:0:5838:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.146@tcp 20000000:01000000:3.0:1790710695.658502:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.146@tcp (null) (null) (null) 00000040:00080000:3.0:1790710695.658534:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1790710695.658542:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1790710695.658584:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1790710695.658592:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.206.146@tcp (null) (null) 00000040:00080000:3.0:1790710695.658620:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1790710695.658628:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1790710695.658656:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1790710695.658703:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:3.0:1790710695.659525:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1790710695.659542:0:5838:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.146@tcp 20000000:01000000:3.0:1790710695.659544:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.146@tcp (null) (null) (null) 00000040:00080000:3.0:1790710695.659588:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1790710695.659596:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1790710695.659623:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1790710695.659630:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.206.146@tcp (null) (null) 00000040:00080000:3.0:1790710695.659671:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1790710695.659679:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1790710695.659710:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:3.0:1790710695.659743:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:3.0:1790710695.659759:0:5838:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:3.0:1790710695.659762:0:5838:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1790710695.659765:0:5838:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1790710695.659776:0:5838:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1790710695.659779:0:5838:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1790710695.659811:0:5838:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1790710695.659813:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1790710695.660464:0:6708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:3.0:1790710695.660728:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:3.0:1790710695.660766:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:3.0:1790710695.660823:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:3.0:1790710695.660835:0:5838:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1790710695.660910:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1790710695.661406:0:6709:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1790710695.661455:0:6709:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1790710695.661505:0:6709:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1790710695.661724:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1790710695.661761:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1790710695.661814:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1790710695.661827:0:5838:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1790710695.661829:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1790710695.663726:0:6710:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 10 1->4: lustre sys.timeout 20000000:01000000:0.0:1790710695.663798:0:6710:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 10 2->4: lustre sys.timeout 00000040:00080000:0.0:1790710695.663862:0:6710:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1790710695.664344:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:3.0:1790710695.664371:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:3.0:1790710695.664388:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:3.0:1790710695.664398:0:5838:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:3.0:1790710695.664400:0:5838:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:3.0:1790710695.664464:0:5838:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1790710695.664479:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c520216b000/0xcbad34b281570b19 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710695.664493:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c51c13fd200/0xcbad34b281570a32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281570a2b expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710695.664499:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c51c13fc200/0xcbad34b281570a4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281570a47 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710695.664503:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c51c0030c00/0xcbad34b281570abe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281570ab7 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710695.664508:0:5838:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c520216b000/0xcbad34b281570b19 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710695.664536:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c51c0030c00/0xcbad34b281570abe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbad34b281570ab7 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710695.664547:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c51c0030c00/0xcbad34b281570abe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbad34b281570ab7 expref: 12 pid: 5840 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710695.664556:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f8ce7100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5838:1877696176985216:0@lo:104: 00000100:00100000:3.0:1790710695.664602:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710695.664642:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176985216 00000100:00100000:0.0:1790710695.664654:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176985216 00000100:00100000:0.0:1790710695.664698:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790710695.664707:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f8ce5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5d27fc27-b651-404a-bd8c-b798806fb18a+3:5838:x1877696176985216:12345-0@lo:104: 00010000:00010000:0.0:1790710695.664719:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.146@tcp lock: ffff9c51c13fd000/0xcbad34b281570ab7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbad34b281570abe expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710695.664738:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c51c13fc200/0xcbad34b281570a4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbad34b281570a47 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710695.664746:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c51c13fc200/0xcbad34b281570a4e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbad34b281570a47 expref: 12 pid: 5837 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710695.664754:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f8ce5880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5838:1877696176985344:0@lo:104: 00010000:00010000:0.0:1790710695.664770:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790710695.664775:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f8ce5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5d27fc27-b651-404a-bd8c-b798806fb18a+3:5838:x1877696176985216:12345-0@lo:104: Request processed in 70us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710695.664780:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710695.664782:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790710695.664796:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176985344 00000100:00100000:0.0:1790710695.664799:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176985344 00010000:00010000:3.0:1790710695.664800:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c51c13fd200/0xcbad34b281570a32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbad34b281570a2b expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710695.664808:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c51c13fd200/0xcbad34b281570a32 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbad34b281570a2b expref: 12 pid: 5837 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710695.664812:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790710695.664816:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f8ce4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5d27fc27-b651-404a-bd8c-b798806fb18a+3:5838:x1877696176985344:12345-0@lo:104: 00000100:00100000:3.0:1790710695.664817:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f8ce6d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5838:1877696176985472:0@lo:104: 00010000:00010000:0.0:1790710695.664823:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.146@tcp lock: ffff9c520216be00/0xcbad34b281570a47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbad34b281570a4e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710695.664834:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710695.664843:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f01e6780 going to sleep for 11 seconds 00000100:00100000:3.0:1790710695.664862:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f8ce7100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5838:1877696176985216:0@lo:104: 00010000:00010000:2.0:1790710695.664924:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790710695.664933:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1790710695.664936:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.146@tcp lock: ffff9c51c13fd000/0xcbad34b281570ab7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbad34b281570abe expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710695.664938:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f8ce4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5d27fc27-b651-404a-bd8c-b798806fb18a+3:5838:x1877696176985344:12345-0@lo:104: Request processed in 121us (156us total) trans 0 rc 0/0 00010000:00010000:2.0:1790710695.664943:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c13fd000 already unused, calling callback (ffffffffc1cdfc20) 10000000:00010000:2.0:1790710695.664947:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.146@tcp lock: ffff9c51c13fd000/0xcbad34b281570ab7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbad34b281570abe expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710695.664947:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1790710695.664955:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.146@tcp lock: ffff9c51c13fd000/0xcbad34b281570ab7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbad34b281570abe expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710695.664957:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176985472 00000100:00100000:0.0:1790710695.664961:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176985472 10000000:00010000:2.0:1790710695.664962:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.146@tcp lock: ffff9c51c13fd000/0xcbad34b281570ab7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbad34b281570abe expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790710695.664968:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1790710695.664972:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790710695.664976:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f8ce7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5d27fc27-b651-404a-bd8c-b798806fb18a+3:5838:x1877696176985472:12345-0@lo:104: 00010000:00010000:0.0:1790710695.664983:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.146@tcp lock: ffff9c520216b600/0xcbad34b281570a2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbad34b281570a32 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710695.664993:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.146@tcp lock: ffff9c51c13fd000/0xcbad34b281570ab7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281570abe expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710695.664999:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790710695.665008:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1790710695.665012:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f8ce7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5d27fc27-b651-404a-bd8c-b798806fb18a+3:5838:x1877696176985472:12345-0@lo:104: Request processed in 36us (177us total) trans 0 rc 0/0 00010000:00010000:2.0:1790710695.665015:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.146@tcp lock: ffff9c51c13fd000/0xcbad34b281570ab7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281570abe expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710695.665018:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1790710695.665027:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.146@tcp lock: ffff9c51c13fd000/0xcbad34b281570ab7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281570abe expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710695.665048:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c8e8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d27fc27-b651-404a-bd8c-b798806fb18a:3309:1877696176985600:0@lo:103: 00010000:00010000:2.0:1790710695.665054:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790710695.665057:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.146@tcp lock: ffff9c520216be00/0xcbad34b281570a47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbad34b281570a4e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710695.665063:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c520216be00 already unused, calling callback (ffffffffc1cdfc20) 10000000:00010000:2.0:1790710695.665065:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.146@tcp lock: ffff9c520216be00/0xcbad34b281570a47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbad34b281570a4e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710695.665072:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790710695.665080:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.146@tcp lock: ffff9c520216be00/0xcbad34b281570a47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbad34b281570a4e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790710695.665087:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.146@tcp lock: ffff9c520216be00/0xcbad34b281570a47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbad34b281570a4e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790710695.665092:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790710695.665105:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.146@tcp lock: ffff9c520216be00/0xcbad34b281570a47 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281570a4e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710695.665110:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790710695.665115:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.146@tcp lock: ffff9c520216be00/0xcbad34b281570a47 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281570a4e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710695.665121:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.146@tcp lock: ffff9c520216be00/0xcbad34b281570a47 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281570a4e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710695.665153:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790710695.665156:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.146@tcp lock: ffff9c520216b600/0xcbad34b281570a2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbad34b281570a32 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710695.665162:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c520216b600 already unused, calling callback (ffffffffc1cdfc20) 00000100:00100000:0.0:1790710695.665164:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 10000000:00010000:2.0:1790710695.665165:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.146@tcp lock: ffff9c520216b600/0xcbad34b281570a2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbad34b281570a32 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710695.665170:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c8e8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d27fc27-b651-404a-bd8c-b798806fb18a:3309:1877696176985728:0@lo:103: 00010000:00010000:2.0:1790710695.665171:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.146@tcp lock: ffff9c520216b600/0xcbad34b281570a2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbad34b281570a32 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790710695.665178:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.146@tcp lock: ffff9c520216b600/0xcbad34b281570a2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbad34b281570a32 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790710695.665188:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1790710695.665190:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790710695.665200:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.146@tcp lock: ffff9c520216b600/0xcbad34b281570a2b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281570a32 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710695.665206:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1790710695.665261:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176985600 00000100:00100000:3.0:1790710695.665264:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176985600 00010000:00010000:3.0:1790710695.665280:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c51c0030c00/0xcbad34b281570abe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbad34b281570ab7 expref: 13 pid: 5840 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710695.665296:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176985728 00000100:00100000:3.0:1790710695.665298:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176985728 00010000:00010000:3.0:1790710695.665305:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c51c13fc200/0xcbad34b281570a4e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbad34b281570a47 expref: 14 pid: 5837 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710695.665314:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790710695.665319:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9575180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d27fc27-b651-404a-bd8c-b798806fb18a+14:3309:x1877696176985600:12345-0@lo:103: 00010000:00010000:3.0:1790710695.665327:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790710695.665330:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c51c0030c00/0xcbad34b281570abe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbad34b281570ab7 expref: 14 pid: 5840 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710695.665338:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c51c0030c00/0xcbad34b281570abe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbad34b281570ab7 expref: 14 pid: 5840 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710695.665360:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.146@tcp lock: ffff9c520216b600/0xcbad34b281570a2b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281570a32 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710695.665367:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.146@tcp lock: ffff9c520216b600/0xcbad34b281570a2b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281570a32 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710695.665379:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710695.665381:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710695.665382:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790710695.665396:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c8e8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d27fc27-b651-404a-bd8c-b798806fb18a:3311:1877696176985856:0@lo:103: 00000100:00100000:2.0:1790710695.665427:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790710695.665460:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c51c0030c00/0xcbad34b281570abe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbad34b281570ab7 expref: 14 pid: 5840 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710695.665470:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790710695.665487:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9575180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d27fc27-b651-404a-bd8c-b798806fb18a+13:3309:x1877696176985600:12345-0@lo:103: Request processed in 169us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710695.665493:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790710695.665503:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176985856 00000100:00100000:3.0:1790710695.665505:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176985856 00010000:00010000:3.0:1790710695.665513:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c51c13fd200/0xcbad34b281570a32 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbad34b281570a2b expref: 13 pid: 5837 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710695.665523:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790710695.665528:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9575880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d27fc27-b651-404a-bd8c-b798806fb18a+13:3309:x1877696176985728:12345-0@lo:103: 00010000:00010000:3.0:1790710695.665533:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790710695.665536:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c51c13fc200/0xcbad34b281570a4e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbad34b281570a47 expref: 13 pid: 5837 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710695.665543:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c51c13fc200/0xcbad34b281570a4e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbad34b281570a47 expref: 13 pid: 5837 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710695.665551:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790710695.665566:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9575880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d27fc27-b651-404a-bd8c-b798806fb18a+13:3309:x1877696176985728:12345-0@lo:103: Request processed in 38us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710695.665571:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790710695.665579:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790710695.665583:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8e8c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d27fc27-b651-404a-bd8c-b798806fb18a+12:3311:x1877696176985856:12345-0@lo:103: 00010000:00010000:3.0:1790710695.665598:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790710695.665604:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c51c13fd200/0xcbad34b281570a32 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbad34b281570a2b expref: 12 pid: 5837 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710695.665611:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c51c13fd200/0xcbad34b281570a32 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbad34b281570a2b expref: 12 pid: 5837 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710695.665621:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c520216b000/0xcbad34b281570b19 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710695.665628:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c520216b000/0xcbad34b281570b19 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710695.665639:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c520216b000/0xcbad34b281570b19 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710695.665645:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c520216b000/0xcbad34b281570b19 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710695.665651:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c520216b000/0xcbad34b281570b19 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710695.665657:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c520216b000/0xcbad34b281570b19 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710695.665661:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c520216b000 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:3.0:1790710695.665664:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c520216b000/0xcbad34b281570b19 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710695.665671:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c520216b000/0xcbad34b281570b19 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710695.665677:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c520216b000/0xcbad34b281570b19 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710695.665693:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790710695.665709:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8e8c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d27fc27-b651-404a-bd8c-b798806fb18a+12:3311:x1877696176985856:12345-0@lo:103: Request processed in 125us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710695.665714:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1790710695.665752:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c51c13fc200/0xcbad34b281570a4e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbad34b281570a47 expref: 11 pid: 5837 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710695.665761:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f8ce5880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5838:1877696176985344:0@lo:104: 00010000:00010000:3.0:1790710695.665770:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c51c13fd200/0xcbad34b281570a32 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbad34b281570a2b expref: 10 pid: 5837 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710695.665778:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f8ce6d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5838:1877696176985472:0@lo:104: 00010000:00010000:3.0:1790710695.665796:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c520216b000/0xcbad34b281570b19 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710695.665804:0:5838:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c520216b000/0xcbad34b281570b19 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710695.665809:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c520216b000/0xcbad34b281570b19 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710695.665814:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c520216b000/0xcbad34b281570b19 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1790710695.665824:0:5838:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1790710695.666293:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c8e8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d27fc27-b651-404a-bd8c-b798806fb18a:3309:1877696176985728:0@lo:103: 00000100:00100000:0.0:1790710695.666301:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c8e8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d27fc27-b651-404a-bd8c-b798806fb18a:3309:1877696176985600:0@lo:103: 00000100:00100000:2.0:1790710695.666866:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c8e8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d27fc27-b651-404a-bd8c-b798806fb18a:3311:1877696176985856:0@lo:103: 00010000:00010000:1.0:1790710695.667089:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790710695.716619:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ee78a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+9:6693:x1877696176985088:12345-0@lo:253: Request processed in 60225us (60666us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710695.716633:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790710695.719150:0:6693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c8e8f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:6693:1877696176985088:0@lo:253: 10000000:01000000:2.0:1790710695.719178:0:6693:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1790710695.719181:0:6693:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790710695.719183:0:6693:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790710695.719184:0:6693:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790710695.719185:0:6693:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1790710695.719186:0:6693:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790710695.719187:0:6693:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790710695.719189:0:6693:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790710695.719191:0:6693:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1790710695.719192:0:6693:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790710695.719193:0:6693:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1790710695.719219:0:6693:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c51f444d000 from lustre-OST0000 10000000:01000000:2.0:1790710695.719256:0:6693:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1790710695.719259:0:6693:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1790710695.719265:0:6693:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9c51d02d19c0 local copy 10000000:01000000:2.0:1790710695.719269:0:6693:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1790710695.719307:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c8046e00/0xcbad34b281570b20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710695.719318:0:6693:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.146@tcp lock: ffff9c51c8046e00/0xcbad34b281570b20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710695.719328:0:6693:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.146@tcp lock: ffff9c51c8046e00/0xcbad34b281570b20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710695.719346:0:6693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c8e8f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:6693:1877696176985984:0@lo:101: 00000100:00100000:2.0:1790710695.719414:0:6693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710695.719702:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176985984 00000100:00100000:2.0:1790710695.719704:0:6693:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c3f6d540 going to sleep for 11 seconds 00000100:00100000:1.0:1790710695.719709:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176985984 00000100:00100000:1.0:1790710695.720588:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790710695.720609:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ee788450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+9:6693:x1877696176985984:12345-0@lo:101: 00010000:00010000:1.0:1790710695.720625:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790710695.720640:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c51c1645800/0xcbad34b281570b27 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbad34b281570b20 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710695.720665:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c51c1645800/0xcbad34b281570b27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbad34b281570b20 expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710695.720676:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c51c1645800/0xcbad34b281570b27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281570b20 expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710695.720684:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c1645800, rc 0) 00000100:00100000:1.0:1790710695.720813:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ee788450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+10:6693:x1877696176985984:12345-0@lo:101: Request processed in 205us (1397us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710695.720820:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790710695.723271:0:6693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c8e8f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:6693:1877696176985984:0@lo:101: 00010000:00010000:2.0:1790710695.723299:0:6693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.146@tcp lock: ffff9c51c8046e00/0xcbad34b281570b20 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xcbad34b281570b27 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710695.723311:0:6693:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.146@tcp lock: ffff9c51c8046e00/0xcbad34b281570b20 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xcbad34b281570b27 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710695.723437:0:6693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c8e8f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:6693:1877696176986112:0@lo:501: 00000100:00100000:2.0:1790710695.723488:0:6693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710695.723535:0:6693:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c3f6d540 going to sleep for 11 seconds 00000100:00100000:3.0:1790710695.723921:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176986112 00000100:00100000:3.0:1790710695.723928:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176986112 00000100:00100000:3.0:1790710695.723975:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1790710695.723984:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ee788850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+10:6693:x1877696176986112:12345-0@lo:501: 00000100:00100000:3.0:1790710695.725331:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ee788850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+10:6693:x1877696176986112:12345-0@lo:501: Request processed in 1343us (1837us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790710695.725343:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790710695.725615:0:6693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c8e8f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:6693:1877696176986112:0@lo:501: 10000000:01000000:2.0:1790710695.725637:0:6693:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.146@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1790710695.725675:0:6693:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.146@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1790710695.725689:0:6693:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c8046e00/0xcbad34b281570b20 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xcbad34b281570b27 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710695.725699:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c8046e00/0xcbad34b281570b20 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xcbad34b281570b27 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710695.725705:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.146@tcp lock: ffff9c51c8046e00/0xcbad34b281570b20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xcbad34b281570b27 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710695.725729:0:6693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1790710695.725876:0:6693:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c51f444d000 10000000:01000000:2.0:1790710695.725882:0:6693:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1790710695.725887:0:6693:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9c51d02d19c0 10000000:01000000:2.0:1790710695.725889:0:6693:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1790710695.725893:0:6693:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9c51d02d19c0 from 1 10000000:01000000:2.0:1790710695.725896:0:6693:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1790710695.725925:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c8046400/0xcbad34b281570b2e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710695.725934:0:6693:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.146@tcp lock: ffff9c51c8046400/0xcbad34b281570b2e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710695.725944:0:6693:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.146@tcp lock: ffff9c51c8046400/0xcbad34b281570b2e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710695.725962:0:6693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c8e8f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:6693:1877696176986240:0@lo:101: 00000100:00100000:2.0:1790710695.725997:0:6693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710695.726186:0:6693:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c3f6d3c0 going to sleep for 11 seconds 00010000:00010000:3.0:1790710695.726714:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790710695.726722:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.146@tcp lock: ffff9c51c8046e00/0xcbad34b281570b20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xcbad34b281570b27 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710695.726729:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c8046e00 already unused, calling callback (ffffffffc1cdfc20) 10000000:00010000:3.0:1790710695.726733:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.146@tcp lock: ffff9c51c8046e00/0xcbad34b281570b20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xcbad34b281570b27 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710695.726741:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.146@tcp lock: ffff9c51c8046e00/0xcbad34b281570b20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xcbad34b281570b27 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790710695.726757:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.146@tcp lock: ffff9c51c8046e00/0xcbad34b281570b20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xcbad34b281570b27 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790710695.726762:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790710695.726784:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.146@tcp lock: ffff9c51c8046e00/0xcbad34b281570b20 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xcbad34b281570b27 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710695.726802:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790710695.726828:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.146@tcp lock: ffff9c51c8046e00/0xcbad34b281570b20 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xcbad34b281570b27 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710695.726834:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.146@tcp lock: ffff9c51c8046e00/0xcbad34b281570b20 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xcbad34b281570b27 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710695.726860:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790710695.726862:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790710695.726864:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790710695.726974:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f8ce6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d27fc27-b651-404a-bd8c-b798806fb18a:3312:1877696176986368:0@lo:103: 00000100:00100000:2.0:1790710695.727012:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710695.727369:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176986368 00000100:00100000:3.0:1790710695.727376:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176986368 00000100:00100000:3.0:1790710695.727425:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790710695.727434:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8e8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d27fc27-b651-404a-bd8c-b798806fb18a+10:3312:x1877696176986368:12345-0@lo:103: 00010000:00010000:3.0:1790710695.727447:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790710695.727462:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c51c1645800/0xcbad34b281570b27 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcbad34b281570b20 expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710695.727477:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790710695.727512:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8e8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d27fc27-b651-404a-bd8c-b798806fb18a+9:3312:x1877696176986368:12345-0@lo:103: Request processed in 79us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710695.727519:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790710695.727633:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f8ce6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d27fc27-b651-404a-bd8c-b798806fb18a:3312:1877696176986368:0@lo:103: 00000100:00100000:1.0:1790710695.727960:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176986240 00000100:00100000:1.0:1790710695.727966:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176986240 00000100:00100000:1.0:1790710695.728050:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1790710695.728059:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ee78a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+9:6693:x1877696176986240:12345-0@lo:101: 00010000:00010000:1.0:1790710695.728070:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790710695.728083:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c51c1644c00/0xcbad34b281570b35 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbad34b281570b2e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710695.728106:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c51c1644c00/0xcbad34b281570b35 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbad34b281570b2e expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710695.728116:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c51c1644c00/0xcbad34b281570b35 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281570b2e expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710695.728124:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c1644c00, rc 0) 00000100:00100000:1.0:1790710695.728197:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ee78a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+10:6693:x1877696176986240:12345-0@lo:101: Request processed in 140us (2199us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710695.728203:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790710695.728291:0:6693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c8e8f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:6693:1877696176986240:0@lo:101: 00010000:00010000:3.0:1790710695.728304:0:6693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.146@tcp lock: ffff9c51c8046400/0xcbad34b281570b2e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570b35 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710695.728314:0:6693:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.146@tcp lock: ffff9c51c8046400/0xcbad34b281570b2e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbad34b281570b35 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790710695.728329:0:6693:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.146@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1790710695.728338:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c8046400/0xcbad34b281570b2e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570b35 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710695.728345:0:6693:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.146@tcp lock: ffff9c51c8046400/0xcbad34b281570b2e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570b35 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790710695.728359:0:6693:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1790710695.728364:0:6693:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790710695.728369:0:6693:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1790710695.728372:0:6693:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1790710695.728393:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c520216b000/0xcbad34b281570b3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710695.728400:0:6693:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.146@tcp lock: ffff9c520216b000/0xcbad34b281570b3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710695.728408:0:6693:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.146@tcp lock: ffff9c520216b000/0xcbad34b281570b3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710695.728423:0:6693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f8ce5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:6693:1877696176986496:0@lo:101: 00000100:00100000:3.0:1790710695.728450:0:6693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710695.732583:0:6693:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f01e6600 going to sleep for 11 seconds 00000100:00100000:2.0:1790710695.734987:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176986496 00000100:00100000:2.0:1790710695.735000:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176986496 00000100:00100000:3.0:1790710695.735355:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1790710695.735366:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ee789850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+10:6693:x1877696176986496:12345-0@lo:101: 00010000:00010000:3.0:1790710695.735382:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790710695.735402:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c520216ba00/0xcbad34b281570b43 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbad34b281570b3c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710695.735427:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c520216ba00/0xcbad34b281570b43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbad34b281570b3c expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710695.735438:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c520216ba00/0xcbad34b281570b43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281570b3c expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710695.735464:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c520216ba00, rc 0) 00000100:00100000:3.0:1790710695.735538:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ee789850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+11:6693:x1877696176986496:12345-0@lo:101: Request processed in 174us (7086us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710695.735544:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1790710695.735651:0:6693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f8ce5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:6693:1877696176986496:0@lo:101: 00010000:00010000:2.0:1790710695.735667:0:6693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.146@tcp lock: ffff9c520216b000/0xcbad34b281570b3c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570b43 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710695.735676:0:6693:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.146@tcp lock: ffff9c520216b000/0xcbad34b281570b3c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbad34b281570b43 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710695.735911:0:6693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c8e8df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:6693:1877696176986624:0@lo:501: 00000100:00100000:2.0:1790710695.735945:0:6693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710695.735979:0:6693:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c3f6d600 going to sleep for 11 seconds 00000100:00100000:3.0:1790710695.736046:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176986624 00000100:00100000:3.0:1790710695.736050:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176986624 00000100:00100000:3.0:1790710695.736071:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1790710695.736077:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ee789050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+11:6693:x1877696176986624:12345-0@lo:501: 00000100:00100000:3.0:1790710695.736316:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ee789050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+11:6693:x1877696176986624:12345-0@lo:501: Request processed in 238us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710695.736323:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790710695.736456:0:6693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c8e8df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:6693:1877696176986624:0@lo:501: 00000100:00100000:2.0:1790710695.736486:0:6693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c8e8df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:6693:1877696176986752:0@lo:503: 00000100:00100000:2.0:1790710695.736526:0:6693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710695.736555:0:6693:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c3f6d600 going to sleep for 11 seconds 00000100:00100000:3.0:1790710695.736608:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176986752 00000100:00100000:3.0:1790710695.736612:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176986752 00000100:00100000:3.0:1790710695.736630:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1790710695.736636:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ee78b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+11:6693:x1877696176986752:12345-0@lo:503: 00000100:00100000:3.0:1790710695.736787:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ee78b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+11:6693:x1877696176986752:12345-0@lo:503: Request processed in 151us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710695.736928:0:6693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c8e8df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:6693:1877696176986752:0@lo:503: 00000040:00080000:2.0:1790710695.737195:0:6693:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790710695.737256:0:6693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c8e8df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:6693:1877696176986880:0@lo:502: 00000100:00100000:2.0:1790710695.737293:0:6693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710695.737302:0:6693:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c3f6d600 going to sleep for 11 seconds 00000100:00100000:3.0:1790710695.737437:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1790710695.737467:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176986880 00000100:00100000:3.0:1790710695.737471:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176986880 00000100:00100000:3.0:1790710695.737488:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1790710695.737494:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ee789c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+11:6693:x1877696176986880:12345-0@lo:502: 00000100:00100000:3.0:1790710695.737626:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ee789c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+11:6693:x1877696176986880:12345-0@lo:502: Request processed in 131us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710695.737632:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1790710695.737776:0:6693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c8e8df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:6693:1877696176986880:0@lo:502: 00000040:00080000:2.0:1790710695.738264:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1790710695.738315:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1790710695.738346:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1790710695.738402:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1790710695.738437:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1790710695.738471:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1790710695.738500:0:6693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c8e8df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:6693:1877696176987008:0@lo:502: 00000100:00100000:2.0:1790710695.738544:0:6693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710695.738576:0:6693:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c3f6d600 going to sleep for 11 seconds 00000100:00100000:3.0:1790710695.738670:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176987008 00000100:00100000:3.0:1790710695.738680:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176987008 00000100:00100000:3.0:1790710695.738707:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1790710695.738713:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8ff8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+11:6693:x1877696176987008:12345-0@lo:502: 00000100:00100000:3.0:1790710695.739115:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8ff8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+11:6693:x1877696176987008:12345-0@lo:502: Request processed in 400us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710695.739122:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790710695.739958:0:6693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c8e8df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:6693:1877696176987008:0@lo:502: 00000040:00080000:2.0:1790710695.740987:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1790710695.741004:0:6693:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:3.0:1790710695.742291:0:6711:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1790710695.742300:0:6711:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1790710695.742307:0:6711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790710695.742309:0:6711:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1790710695.742314:0:6711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790710695.742326:0:6711:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9c51fa3d19c0) 00000020:00000080:3.0:1790710695.742344:0:6711:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:3.0:1790710695.742349:0:6711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1790710695.742417:0:6711:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c51f444d000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1790710695.742424:0:6711:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1790710695.742431:0:6711:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xcbad34b281570b51 00010000:00010000:3.0:1790710695.750276:0:6711:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:3.0:1790710695.750597:0:6711:0:(tgt_lastrcvd.c:1879:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1790710695.754946:0:6711:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1790710695.755289:0:6711:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:1.0:1790710695.766626:0:6711:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1790710695.767525:0:6711:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1790710695.771231:0:6711:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1790710695.771243:0:6711:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790710695.771249:0:6711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790710695.771251:0:6711:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1790710695.771255:0:6711:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790710695.771259:0:6711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790710695.771260:0:6711:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:1.0:1790710695.771263:0:6711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1790710695.771265:0:6711:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1790710695.771320:0:6711:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790710695.771324:0:6711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790710695.771325:0:6711:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:1.0:1790710695.771329:0:6711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1790710695.773413:0:6693:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1790710695.773450:0:6693:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.146@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1790710695.773465:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c520216b000/0xcbad34b281570b3c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570b43 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710695.773477:0:6693:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.146@tcp lock: ffff9c520216b000/0xcbad34b281570b3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570b43 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790710695.773486:0:6693:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c51f444d000 from 1 10000000:01000000:2.0:1790710695.773488:0:6693:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790710695.773520:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c8047800/0xcbad34b281570b58 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710695.773528:0:6693:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.146@tcp lock: ffff9c51c8047800/0xcbad34b281570b58 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710695.773537:0:6693:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.146@tcp lock: ffff9c51c8047800/0xcbad34b281570b58 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710695.773557:0:6693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c8e8df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:6693:1877696176987136:0@lo:101: 00000100:00100000:2.0:1790710695.773617:0:6693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710695.773679:0:6693:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c3f6d900 going to sleep for 11 seconds 00000100:00100000:1.0:1790710695.773837:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176987136 00000100:00100000:1.0:1790710695.773845:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176987136 00000100:00100000:1.0:1790710695.774119:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1790710695.774154:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8ff8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+11:6693:x1877696176987136:12345-0@lo:101: 00010000:00010000:1.0:1790710695.774169:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790710695.774182:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c51c1645000/0xcbad34b281570b5f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbad34b281570b58 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710695.774205:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c51c1645000/0xcbad34b281570b5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbad34b281570b58 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710695.774215:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c51c1645000/0xcbad34b281570b5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281570b58 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710695.774236:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c1645000, rc 0) 00000100:00100000:1.0:1790710695.774277:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8ff8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+12:6693:x1877696176987136:12345-0@lo:101: Request processed in 150us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710695.774284:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790710695.774959:0:6693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c8e8df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:6693:1877696176987136:0@lo:101: 00010000:00010000:2.0:1790710695.774979:0:6693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.146@tcp lock: ffff9c51c8047800/0xcbad34b281570b58 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570b5f expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710695.774987:0:6693:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.146@tcp lock: ffff9c51c8047800/0xcbad34b281570b58 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbad34b281570b5f expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710695.775619:0:6693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c8e8df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:6693:1877696176987264:0@lo:501: 00000100:00100000:2.0:1790710695.775664:0:6693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710695.775700:0:6693:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c3f6d900 going to sleep for 11 seconds 00000100:00100000:3.0:1790710695.775881:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176987264 00000100:00100000:3.0:1790710695.775898:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176987264 00000100:00100000:3.0:1790710695.775938:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790710695.775948:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8ffa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+12:6693:x1877696176987264:12345-0@lo:501: 00000100:00100000:3.0:1790710695.776210:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8ffa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+12:6693:x1877696176987264:12345-0@lo:501: Request processed in 263us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710695.776217:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790710695.776345:0:6693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c8e8df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:6693:1877696176987264:0@lo:501: 00000100:00100000:2.0:1790710695.776375:0:6693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c8e8df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:6693:1877696176987392:0@lo:503: 00000100:00100000:2.0:1790710695.776414:0:6693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710695.776440:0:6693:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c3f6d900 going to sleep for 11 seconds 00000100:00100000:3.0:1790710695.776598:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176987392 00000100:00100000:3.0:1790710695.776603:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176987392 00000100:00100000:3.0:1790710695.776640:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1790710695.776647:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8ff9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+12:6693:x1877696176987392:12345-0@lo:503: 00000100:00100000:2.0:1790710695.777190:0:6693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c8e8df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:6693:1877696176987392:0@lo:503: 00000040:00080000:2.0:1790710695.777427:0:6693:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790710695.777485:0:6693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c8e8df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:6693:1877696176987520:0@lo:502: 00000100:00100000:2.0:1790710695.777524:0:6693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710695.777539:0:6693:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c3f6d900 going to sleep for 11 seconds 00000100:00100000:3.0:1790710695.777600:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8ff9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+12:6693:x1877696176987392:12345-0@lo:503: Request processed in 952us (1184us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710695.777608:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1790710695.777637:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176987520 00000100:00100000:3.0:1790710695.777641:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176987520 00000100:00100000:3.0:1790710695.777662:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1790710695.777668:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8ff9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+12:6693:x1877696176987520:12345-0@lo:502: 00000100:00100000:3.0:1790710695.777861:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8ff9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+12:6693:x1877696176987520:12345-0@lo:502: Request processed in 192us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710695.777867:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790710695.778374:0:6693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c8e8df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:6693:1877696176987520:0@lo:502: 00000040:00080000:2.0:1790710695.778625:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1790710695.778675:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1790710695.778702:0:6693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c8e8df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:6693:1877696176987648:0@lo:502: 00000100:00100000:2.0:1790710695.778743:0:6693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710695.778781:0:6693:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c3f6d900 going to sleep for 11 seconds 00000100:00100000:1.0:1790710695.778881:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176987648 00000100:00100000:1.0:1790710695.778896:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176987648 00000100:00100000:1.0:1790710695.778928:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1790710695.778934:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8ffb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+12:6693:x1877696176987648:12345-0@lo:502: 00000100:00100000:1.0:1790710695.779095:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8ffb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+12:6693:x1877696176987648:12345-0@lo:502: Request processed in 160us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710695.779102:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790710695.779733:0:6693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c8e8df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:6693:1877696176987648:0@lo:502: 00000040:00080000:2.0:1790710695.779848:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1790710695.779859:0:6693:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1790710695.780711:0:6715:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790710695.780720:0:6715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790710695.780722:0:6715:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1790710695.780728:0:6715:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c51f444d000 00000020:00000080:3.0:1790710695.780731:0:6715:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790710695.780760:0:6715:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790710695.780763:0:6715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790710695.780765:0:6715:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1790710695.780768:0:6715:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1790710695.780981:0:6693:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1790710695.781000:0:6693:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790710695.781023:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c8047800/0xcbad34b281570b58 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570b5f expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710695.781046:0:6693:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.146@tcp lock: ffff9c51c8047800/0xcbad34b281570b58 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570b5f expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790710695.781082:0:6693:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1790710695.781084:0:6693:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c51f444d000 10000000:01000000:1.0:1790710695.781087:0:6693:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c51f444d000 10000000:01000000:1.0:1790710695.781090:0:6693:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790710695.781095:0:6693:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c51f444d000 from 1 10000000:01000000:1.0:1790710695.781097:0:6693:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1790710695.781158:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c1645a00/0xcbad34b281570b66 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710695.781177:0:6693:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.146@tcp lock: ffff9c51c1645a00/0xcbad34b281570b66 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710695.781190:0:6693:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.146@tcp lock: ffff9c51c1645a00/0xcbad34b281570b66 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710695.781208:0:6693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c812e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:6693:1877696176987776:0@lo:101: 00000100:00100000:1.0:1790710695.781261:0:6693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710695.781293:0:6693:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c80c6a80 going to sleep for 11 seconds 00000100:00100000:1.0:1790710695.781310:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176987776 00000100:00100000:1.0:1790710695.781316:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176987776 00000100:00100000:1.0:1790710695.781351:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1790710695.781359:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8ff9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+12:6693:x1877696176987776:12345-0@lo:101: 00010000:00010000:1.0:1790710695.781371:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790710695.781382:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c51c1644e00/0xcbad34b281570b6d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbad34b281570b66 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710695.781401:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c51c1644e00/0xcbad34b281570b6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbad34b281570b66 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710695.781411:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c51c1644e00/0xcbad34b281570b6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281570b66 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710695.781419:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c1644e00, rc 0) 00000100:00100000:1.0:1790710695.781453:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8ff9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+13:6693:x1877696176987776:12345-0@lo:101: Request processed in 95us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710695.781460:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1790710695.781501:0:6693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c812e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:6693:1877696176987776:0@lo:101: 00010000:00010000:1.0:1790710695.781520:0:6693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.146@tcp lock: ffff9c51c1645a00/0xcbad34b281570b66 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570b6d expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710695.781528:0:6693:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.146@tcp lock: ffff9c51c1645a00/0xcbad34b281570b66 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbad34b281570b6d expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710695.781598:0:6693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c812e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:6693:1877696176987904:0@lo:501: 00000100:00100000:1.0:1790710695.781623:0:6693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710695.781634:0:6693:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c80c6a80 going to sleep for 11 seconds 00000100:00100000:2.0:1790710695.781777:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176987904 00000100:00100000:2.0:1790710695.781782:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176987904 00000100:00100000:2.0:1790710695.781804:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1790710695.781810:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8ff8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+13:6693:x1877696176987904:12345-0@lo:501: 00000100:00100000:2.0:1790710695.782014:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8ff8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+13:6693:x1877696176987904:12345-0@lo:501: Request processed in 203us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710695.782021:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1790710695.782432:0:6693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c812e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:6693:1877696176987904:0@lo:501: 00000100:00100000:1.0:1790710695.782463:0:6693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c812e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:6693:1877696176988032:0@lo:503: 00000100:00100000:1.0:1790710695.782500:0:6693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710695.782556:0:6693:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c80c6a80 going to sleep for 11 seconds 00000100:00100000:3.0:1790710695.786022:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176988032 00000100:00100000:3.0:1790710695.786046:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176988032 00000100:00100000:2.0:1790710695.786662:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1790710695.786674:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8ffb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+13:6693:x1877696176988032:12345-0@lo:503: 00000100:00100000:2.0:1790710695.787001:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8ffb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+13:6693:x1877696176988032:12345-0@lo:503: Request processed in 327us (4498us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710695.787009:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1790710695.791879:0:6693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c812e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:6693:1877696176988032:0@lo:503: 00000040:00080000:2.0:1790710695.792323:0:6693:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790710695.792396:0:6693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c8e8df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:6693:1877696176988160:0@lo:502: 00000100:00100000:2.0:1790710695.792465:0:6693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710695.792504:0:6693:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c3f6d540 going to sleep for 11 seconds 00000100:00100000:1.0:1790710695.792644:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176988160 00000100:00100000:1.0:1790710695.792651:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176988160 00000100:00100000:1.0:1790710695.792685:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1790710695.792693:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8ffac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+13:6693:x1877696176988160:12345-0@lo:502: 00000100:00100000:1.0:1790710695.792878:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8ffac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+13:6693:x1877696176988160:12345-0@lo:502: Request processed in 185us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710695.792899:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1790710695.793268:0:6693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c8e8df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:6693:1877696176988160:0@lo:502: 00000040:00080000:2.0:1790710695.793502:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1790710695.793547:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1790710695.793590:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1790710695.793638:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1790710695.793675:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1790710695.793722:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1790710695.793772:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1790710695.793820:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1790710695.793876:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1790710695.793988:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1790710695.794022:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1790710695.795020:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1790710695.795364:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1790710695.795402:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1790710695.795472:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1790710695.795511:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1790710695.795547:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1790710695.795592:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1790710695.795636:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1790710695.795667:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1790710695.799377:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1790710695.799459:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1790710695.799496:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1790710695.799548:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1790710695.799583:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1790710695.799615:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1790710695.799659:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1790710695.799709:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1790710695.799769:0:6693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c8e8df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:6693:1877696176988288:0@lo:502: 00000100:00100000:2.0:1790710695.799840:0:6693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710695.800101:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176988288 00000100:00100000:3.0:1790710695.800109:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176988288 00000100:00100000:3.0:1790710695.800184:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1790710695.800194:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8ff8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+13:6693:x1877696176988288:12345-0@lo:502: 00000100:00100000:3.0:1790710695.800372:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8ff8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+13:6693:x1877696176988288:12345-0@lo:502: Request processed in 179us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710695.800389:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1790710695.802002:0:6693:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c3f6d540 going to sleep for 11 seconds 00000100:00100000:2.0:1790710695.802361:0:6693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c8e8df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:6693:1877696176988288:0@lo:502: 00000040:00080000:2.0:1790710695.804007:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1790710695.804028:0:6693:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1790710695.804986:0:6716:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1790710695.805013:0:6716:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9c51ff4acd40) 00000020:00000080:2.0:1790710695.805231:0:6716:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:2.0:1790710695.805316:0:6716:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c51f444d000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1790710695.805325:0:6716:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c51f444d000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1790710695.805327:0:6716:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c51f444d000 3 00010000:00080000:2.0:1790710695.805356:0:6716:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c51ff4b0800@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.146@tcp at head 00010000:00010000:2.0:1790710695.808939:0:6716:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:2.0:1790710695.810657:0:6716:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1790710695.810695:0:6716:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1790710695.810707:0:6716:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xcbad34b281570b7b 00000100:00080000:2.0:1790710695.810718:0:6716:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790710695.810729:0:6716:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c51ff4b0800 using connection 192.168.206.146@tcp/0@lo 00000100:00100000:2.0:1790710695.810777:0:6716:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c51c8e8df80 x1877696176988416/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790710695.810842:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c8e8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3308:1877696176988416:0@lo:38: 00000100:00100000:3.0:1790710695.810903:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1790710695.812207:0:6716:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000040:00080000:2.0:1790710695.812909:0:6716:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000100:00100000:2.0:1790710695.813427:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790710695.813443:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c8e8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877696176988544:0@lo:400: 00000100:00100000:2.0:1790710695.813514:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710695.813555:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176988416 00000100:00100000:2.0:1790710695.813561:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176988416 00000100:00100000:2.0:1790710695.813585:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176988544 00000100:00100000:2.0:1790710695.813589:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176988544 00000100:00100000:2.0:1790710695.813613:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790710695.813621:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8e8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1877696176988544:12345-0@lo:400: 00000100:00100000:2.0:1790710695.813671:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8e8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1877696176988544:12345-0@lo:400: Request processed in 50us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710695.813678:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790710695.813693:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790710695.813697:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f8ce7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3308:x1877696176988416:12345-0@lo:38: 00010000:00080000:2.0:1790710695.813717:0:5845:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 173 last 0 00000020:00000080:2.0:1790710695.814120:0:5845:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xcbad34b281570b82 00000004:00100000:2.0:1790710695.814219:0:5845:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1790710695.814251:0:5845:0:(import.c:65:import_set_state_nolock()) ffff9c51ff4b3800 : changing import state from RECOVER to FULL 00010000:00080000:0.0:1790710695.824151:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c51c8e8ce00 x1877696176988544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790710711 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790710695.824168:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c8e8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877696176988544:0@lo:400: 00000100:00100000:2.0:1790710695.824580:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f8ce7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877696176988416:12345-0@lo:38: Request processed in 10878us (13674us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710695.824590:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:01000000:2.0:1790710695.826275:0:6693:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1790710695.826313:0:6693:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790710695.826368:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c1645a00/0xcbad34b281570b66 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570b6d expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710695.826381:0:6693:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.146@tcp lock: ffff9c51c1645a00/0xcbad34b281570b66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570b6d expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1790710695.826433:0:6693:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1790710695.826436:0:6693:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790710695.826437:0:6693:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790710695.826438:0:6693:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790710695.826439:0:6693:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790710695.826441:0:6693:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790710695.826442:0:6693:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790710695.826444:0:6693:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790710695.826445:0:6693:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790710695.826447:0:6693:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790710695.826448:0:6693:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790710695.826451:0:6693:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1790710695.826454:0:6693:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790710695.826455:0:6693:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790710695.826456:0:6693:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790710695.826457:0:6693:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790710695.826458:0:6693:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790710695.826459:0:6693:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790710695.826460:0:6693:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790710695.826461:0:6693:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790710695.826466:0:6693:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790710695.826467:0:6693:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790710695.826468:0:6693:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790710695.826491:0:6693:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1790710695.826507:0:6693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c8e8d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:6693:1877696176988672:0@lo:253: 00000100:00100000:2.0:1790710695.826565:0:6693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710695.826613:0:6693:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c3f6d180 going to sleep for 11 seconds 00010000:00080000:3.0:1790710695.828237:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c51c8e8df80 x1877696176988416/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790710705 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790710695.828250:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790710695.828259:0:3308:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1790710695.828267:0:3308:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1790710695.828272:0:3308:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1790710695.828275:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9c51ff4b0800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1790710695.828281:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c8e8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3308:1877696176988416:0@lo:38: 00000100:00100000:1.0:1790710695.828811:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176988672 00000100:00100000:1.0:1790710695.828819:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176988672 00000100:00100000:1.0:1790710695.828870:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1790710695.828879:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8ff9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+13:6693:x1877696176988672:12345-0@lo:253: 20000000:01000000:1.0:1790710695.828919:0:5840:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1790710695.828944:0:5840:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1790710695.898478:0:5840:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1790710695.898499:0:5840:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1790710695.898830:0:5861:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1790710695.898835:0:5861:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1790710695.898855:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c51c0030200/0xcbad34b281570b89 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710695.898993:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c51c0030000/0xcbad34b281570ae8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281570ae1 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710695.899002:0:5861:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c51c0030200/0xcbad34b281570b89 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710695.899217:0:5861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c51c0030000/0xcbad34b281570ae8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbad34b281570ae1 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710695.899232:0:5861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c51c0030000/0xcbad34b281570ae8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbad34b281570ae1 expref: 13 pid: 5838 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710695.899245:0:5861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9574380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5861:1877696176988800:0@lo:104: 00000100:00100000:0.0:1790710695.899302:0:5861:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710695.899358:0:5861:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c300d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790710695.899570:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176988800 00000100:00100000:1.0:1790710695.899578:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176988800 00000100:00100000:1.0:1790710695.899628:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790710695.899637:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9576d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5d27fc27-b651-404a-bd8c-b798806fb18a+3:5861:x1877696176988800:12345-0@lo:104: 00010000:00010000:1.0:1790710695.899649:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.146@tcp lock: ffff9c51c13fc400/0xcbad34b281570ae1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbad34b281570ae8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710695.899705:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790710695.899711:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9576d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5d27fc27-b651-404a-bd8c-b798806fb18a+3:5861:x1877696176988800:12345-0@lo:104: Request processed in 76us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710695.899718:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1790710695.899738:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790710695.899744:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.146@tcp lock: ffff9c51c13fc400/0xcbad34b281570ae1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbad34b281570ae8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710695.899751:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c13fc400 already unused, calling callback (ffffffffc1cdfc20) 10000000:00010000:1.0:1790710695.899756:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.146@tcp lock: ffff9c51c13fc400/0xcbad34b281570ae1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbad34b281570ae8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710695.899765:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.146@tcp lock: ffff9c51c13fc400/0xcbad34b281570ae1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbad34b281570ae8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790710695.899772:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.146@tcp lock: ffff9c51c13fc400/0xcbad34b281570ae1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbad34b281570ae8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790710695.899778:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1790710695.899800:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.146@tcp lock: ffff9c51c13fc400/0xcbad34b281570ae1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281570ae8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710695.899812:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790710695.899826:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.146@tcp lock: ffff9c51c13fc400/0xcbad34b281570ae1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281570ae8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710695.899833:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.146@tcp lock: ffff9c51c13fc400/0xcbad34b281570ae1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281570ae8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710695.899848:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790710695.899850:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790710695.899852:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790710695.900096:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c812e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d27fc27-b651-404a-bd8c-b798806fb18a:3310:1877696176988928:0@lo:103: 00000100:00100000:0.0:1790710695.900155:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710695.900200:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176988928 00000100:00100000:0.0:1790710695.900204:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176988928 00010000:00010000:0.0:1790710695.900223:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c51c0030000/0xcbad34b281570ae8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbad34b281570ae1 expref: 14 pid: 5838 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710695.900243:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790710695.900249:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c7cdd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d27fc27-b651-404a-bd8c-b798806fb18a+14:3310:x1877696176988928:12345-0@lo:103: 00010000:00010000:0.0:1790710695.900258:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790710695.900263:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c51c0030000/0xcbad34b281570ae8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbad34b281570ae1 expref: 14 pid: 5838 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710695.900282:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c51c0030000/0xcbad34b281570ae8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbad34b281570ae1 expref: 14 pid: 5838 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710695.900296:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c51c0030200/0xcbad34b281570b89 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710695.900304:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c51c0030200/0xcbad34b281570b89 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1790710695.900317:0:5831:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002018839s 00010000:00010000:0.0:1790710695.900321:0:5831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c51c0030200/0xcbad34b281570b89 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710695.900328:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c51c0030200/0xcbad34b281570b89 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710695.900334:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c51c0030200/0xcbad34b281570b89 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710695.900340:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c51c0030200/0xcbad34b281570b89 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710695.900346:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c0030200 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:0.0:1790710695.900351:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c51c0030200/0xcbad34b281570b89 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710695.900358:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c51c0030200/0xcbad34b281570b89 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710695.900366:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c51c0030200/0xcbad34b281570b89 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710695.900385:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790710695.900414:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c7cdd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d27fc27-b651-404a-bd8c-b798806fb18a+14:3310:x1877696176988928:12345-0@lo:103: Request processed in 165us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710695.900421:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790710695.900570:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c812e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d27fc27-b651-404a-bd8c-b798806fb18a:3310:1877696176988928:0@lo:103: 00010000:00010000:0.0:1790710695.900596:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c51c0030000/0xcbad34b281570ae8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbad34b281570ae1 expref: 13 pid: 5838 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710695.900606:0:5861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9574380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5861:1877696176988800:0@lo:104: 00010000:00010000:0.0:1790710695.900618:0:5861:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c51c0030200/0xcbad34b281570b89 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710695.900627:0:5861:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c51c0030200/0xcbad34b281570b89 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710695.900634:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c51c0030200/0xcbad34b281570b89 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710695.900640:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c51c0030200/0xcbad34b281570b89 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710695.927686:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8ff9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+12:6693:x1877696176988672:12345-0@lo:253: Request processed in 98799us (101111us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710695.927701:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1790710695.927807:0:6693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c8e8d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:6693:1877696176988672:0@lo:253: 10000000:01000000:0.0:1790710695.927823:0:6693:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1790710695.927826:0:6693:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790710695.927827:0:6693:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1790710695.927829:0:6693:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790710695.927830:0:6693:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790710695.927831:0:6693:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790710695.927845:0:6693:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790710695.927847:0:6693:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790710695.927848:0:6693:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790710695.927849:0:6693:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790710695.927851:0:6693:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790710695.927852:0:6693:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1790710695.927869:0:6693:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1790710695.938831:0:6693:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1790710695.942252:0:6693:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1790710695.942766:0:6693:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1790710695.943320:0:6693:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1790710695.948384:0:6693:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1790710695.948657:0:6693:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1790710695.950525:0:6693:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1790710696.239054:0:6693:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1790710696.239060:0:6693:0:(lfsck_lib.c:3084:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1790710696.239091:0:6693:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1790710696.239174:0:6693:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.146@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1790710696.239189:0:6693:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1790710696.239214:0:6693:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1790710696.455511:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790710697.479230:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790710698.508918:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790710699.527379:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790710700.551295:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790710701.320026:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9575880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1877696176989312:0@lo:400: 00000100:00100000:0.0:1790710701.320093:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710701.320182:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176989312 00000100:00100000:0.0:1790710701.320189:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176989312 00000100:00100000:0.0:1790710701.320237:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790710701.320245:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9577480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877696176989312:12345-0@lo:400: 00000100:00100000:0.0:1790710701.320295:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9577480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877696176989312:12345-0@lo:400: Request processed in 51us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710701.320302:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1790710701.320342:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c51f9575880 x1877696176989312/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790710717 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790710701.320354:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9575880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1877696176989312:0@lo:400: 00000100:00100000:1.0:1790710701.320707:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9575180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1877696176989184:0@lo:400: 00000100:00100000:1.0:1790710701.320737:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710701.320799:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790710701.320806:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9574380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d27fc27-b651-404a-bd8c-b798806fb18a:3312:1877696176989056:0@lo:400: 00000100:00100000:1.0:1790710701.320831:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1790710701.320860:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790710701.320872:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176989056 00000100:00100000:1.0:1790710701.320876:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176989056 00000100:00100000:1.0:1790710701.320903:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1790710701.320910:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8ffbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+12:3312:x1877696176989056:12345-0@lo:400: 00000100:00100000:1.0:1790710701.320947:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8ffbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+12:3312:x1877696176989056:12345-0@lo:400: Request processed in 37us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710701.320955:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1790710701.321004:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9574380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d27fc27-b651-404a-bd8c-b798806fb18a:3312:1877696176989056:0@lo:400: 00000100:00100000:0.0:1790710701.321353:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176989184 00000100:00100000:0.0:1790710701.321358:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176989184 00000100:00100000:0.0:1790710701.321417:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790710701.321425:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c812c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1877696176989184:12345-0@lo:400: 00000100:00100000:0.0:1790710701.321509:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c812c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1877696176989184:12345-0@lo:400: Request processed in 85us (770us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710701.321522:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1790710701.321590:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c51f9575180 x1877696176989184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790710717 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790710701.321602:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9575180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1877696176989184:0@lo:400: 00010000:00010000:1.0:1790710701.575423:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1790710702.343362:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1790710702.343369:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c51c67ea000 from 21 10000000:01000000:1.0:1790710702.343374:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1790710702.343417:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c1645200/0xcbad34b281570b90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710702.343428:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.146@tcp lock: ffff9c51c1645200/0xcbad34b281570b90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710702.343439:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.146@tcp lock: ffff9c51c1645200/0xcbad34b281570b90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710702.343461:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c812dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696176989440:0@lo:101: 00000100:00100000:1.0:1790710702.343524:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710702.343572:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c53499c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790710702.343860:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176989440 00000100:00100000:3.0:1790710702.343868:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176989440 00000100:00100000:3.0:1790710702.343909:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1790710702.343918:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8ffa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+12:5842:x1877696176989440:12345-0@lo:101: 00010000:00010000:3.0:1790710702.343931:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790710702.343943:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c520216a000/0xcbad34b281570b97 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbad34b281570b90 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710702.343965:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c520216a000/0xcbad34b281570b97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbad34b281570b90 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710702.343975:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c520216a000/0xcbad34b281570b97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281570b90 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710702.344014:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c520216a000, rc 0) 00000100:00100000:3.0:1790710702.344057:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8ffa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+13:5842:x1877696176989440:12345-0@lo:101: Request processed in 141us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710702.344064:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1790710702.344109:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c812dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696176989440:0@lo:101: 00010000:00010000:3.0:1790710702.344123:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.146@tcp lock: ffff9c51c1645200/0xcbad34b281570b90 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570b97 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710702.344146:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.146@tcp lock: ffff9c51c1645200/0xcbad34b281570b90 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbad34b281570b97 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710702.344200:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f8ce6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696176989568:0@lo:501: 00000100:00100000:3.0:1790710702.344223:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710702.344239:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c8dc73c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790710702.344251:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176989568 00000100:00100000:3.0:1790710702.344254:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176989568 00000100:00100000:3.0:1790710702.344274:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1790710702.344280:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8ffb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+13:5842:x1877696176989568:12345-0@lo:501: 00000100:00100000:3.0:1790710702.344574:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8ffb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+13:5842:x1877696176989568:12345-0@lo:501: Request processed in 293us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710702.344581:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1790710702.344611:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f8ce6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696176989568:0@lo:501: 00000100:00100000:3.0:1790710702.344635:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f8ce6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696176989696:0@lo:503: 00000100:00100000:3.0:1790710702.344671:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710702.344683:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c8dc73c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790710702.344699:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176989696 00000100:00100000:3.0:1790710702.344703:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176989696 00000100:00100000:3.0:1790710702.344723:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1790710702.344729:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8ffa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+13:5842:x1877696176989696:12345-0@lo:503: 00000100:00100000:3.0:1790710702.344974:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8ffa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+13:5842:x1877696176989696:12345-0@lo:503: Request processed in 244us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710702.344981:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1790710702.345033:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f8ce6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696176989696:0@lo:503: 00000100:00100000:3.0:1790710702.345205:0:7019:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f8ce6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d27fc27-b651-404a-bd8c-b798806fb18a:7019:1877696176989824:0@lo:502: 00000100:00100000:3.0:1790710702.345235:0:7019:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710702.345253:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176989824 00000100:00100000:3.0:1790710702.345256:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176989824 00000100:00100000:3.0:1790710702.345276:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1790710702.345282:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ee72a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+13:7019:x1877696176989824:12345-0@lo:502: 00000100:00100000:3.0:1790710702.345439:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ee72a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+13:7019:x1877696176989824:12345-0@lo:502: Request processed in 157us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710702.345446:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1790710702.345473:0:7019:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c8dc7540 going to sleep for 11 seconds 00000100:00100000:3.0:1790710702.345484:0:7019:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f8ce6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d27fc27-b651-404a-bd8c-b798806fb18a:7019:1877696176989824:0@lo:502: 00000100:00100000:3.0:1790710702.345516:0:7019:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f8ce6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d27fc27-b651-404a-bd8c-b798806fb18a:7019:1877696176989952:0@lo:502: 00000100:00100000:3.0:1790710702.345544:0:7019:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710702.345562:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176989952 00000100:00100000:3.0:1790710702.345566:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176989952 00000100:00100000:3.0:1790710702.345584:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1790710702.345590:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ee72a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+13:7019:x1877696176989952:12345-0@lo:502: 00000100:00100000:3.0:1790710702.345691:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ee72a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+13:7019:x1877696176989952:12345-0@lo:502: Request processed in 101us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710702.345704:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1790710702.345730:0:7019:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c8dc7540 going to sleep for 11 seconds 00000100:00100000:3.0:1790710702.345740:0:7019:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f8ce6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d27fc27-b651-404a-bd8c-b798806fb18a:7019:1877696176989952:0@lo:502: 00000040:00080000:3.0:1790710702.345756:0:7019:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1790710702.345802:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1790710702.345816:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790710702.345824:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c1645200/0xcbad34b281570b90 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570b97 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710702.345833:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.146@tcp lock: ffff9c51c1645200/0xcbad34b281570b90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570b97 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790710702.345842:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1790710702.345845:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c51c67ea000 from 4 10000000:01000000:3.0:1790710702.345847:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1790710702.345867:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c520216a800/0xcbad34b281570b9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710702.345874:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.146@tcp lock: ffff9c520216a800/0xcbad34b281570b9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710702.345882:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.146@tcp lock: ffff9c520216a800/0xcbad34b281570b9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710702.345892:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f8ce6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696176990080:0@lo:101: 00000100:00100000:3.0:1790710702.345916:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710702.345929:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c8dc7540 going to sleep for 11 seconds 00000100:00100000:3.0:1790710702.345940:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176990080 00000100:00100000:3.0:1790710702.345943:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176990080 00000100:00100000:3.0:1790710702.345968:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1790710702.345974:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c64efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+13:5842:x1877696176990080:12345-0@lo:101: 00010000:00010000:3.0:1790710702.345982:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790710702.345993:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c520216b400/0xcbad34b281570ba5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbad34b281570b9e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710702.346026:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c520216b400/0xcbad34b281570ba5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbad34b281570b9e expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710702.346036:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c520216b400/0xcbad34b281570ba5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281570b9e expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710702.346044:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c520216b400, rc 0) 00000100:00100000:3.0:1790710702.346072:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c64efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+14:5842:x1877696176990080:12345-0@lo:101: Request processed in 97us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710702.346084:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1790710702.346113:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f8ce6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696176990080:0@lo:101: 00010000:00010000:3.0:1790710702.346125:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.146@tcp lock: ffff9c520216a800/0xcbad34b281570b9e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570ba5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710702.346156:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.146@tcp lock: ffff9c520216a800/0xcbad34b281570b9e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbad34b281570ba5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710702.346194:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f8ce6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696176990208:0@lo:256: 00000100:00100000:3.0:1790710702.346222:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710702.346236:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c8dc7540 going to sleep for 11 seconds 00000100:00100000:3.0:1790710702.346246:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176990208 00000100:00100000:3.0:1790710702.346249:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176990208 00000100:00100000:3.0:1790710702.346268:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1790710702.346279:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c64ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+14:5842:x1877696176990208:12345-0@lo:256: 20000000:01000000:3.0:1790710702.346291:0:5840:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1790710702.346307:0:5840:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1790710702.346309:0:5840:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1790710702.346376:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c64ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+14:5842:x1877696176990208:12345-0@lo:256: Request processed in 97us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710702.346382:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1790710702.346411:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f8ce6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696176990208:0@lo:256: 10000000:01000000:3.0:1790710702.346446:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.146@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790710702.346452:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c520216a800/0xcbad34b281570b9e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570ba5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710702.346459:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.146@tcp lock: ffff9c520216a800/0xcbad34b281570b9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570ba5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790710702.346467:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1790710702.346469:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1790710702.346471:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1790710702.346484:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c520216a600/0xcbad34b281570bac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710702.346491:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.146@tcp lock: ffff9c520216a600/0xcbad34b281570bac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710702.346499:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.146@tcp lock: ffff9c520216a600/0xcbad34b281570bac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710702.346510:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f8ce6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696176990336:0@lo:101: 00000100:00100000:3.0:1790710702.346533:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710702.346552:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c8dc7540 going to sleep for 11 seconds 00000100:00100000:3.0:1790710702.346563:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176990336 00000100:00100000:3.0:1790710702.346566:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176990336 00000100:00100000:3.0:1790710702.346585:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1790710702.346590:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c64ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+14:5842:x1877696176990336:12345-0@lo:101: 00010000:00010000:3.0:1790710702.346596:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790710702.346604:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c520216b600/0xcbad34b281570bb3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbad34b281570bac expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710702.346617:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c520216b600/0xcbad34b281570bb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbad34b281570bac expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710702.346624:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c520216b600/0xcbad34b281570bb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281570bac expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710702.346631:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c520216b600, rc 0) 00000100:00100000:3.0:1790710702.346656:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c64ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+15:5842:x1877696176990336:12345-0@lo:101: Request processed in 66us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710702.346662:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1790710702.346688:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f8ce6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696176990336:0@lo:101: 00010000:00010000:3.0:1790710702.347488:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.146@tcp lock: ffff9c520216a600/0xcbad34b281570bac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570bb3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710702.347503:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.146@tcp lock: ffff9c520216a600/0xcbad34b281570bac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbad34b281570bb3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710702.347557:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f8ce6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696176990464:0@lo:501: 00000100:00100000:3.0:1790710702.347589:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710702.347613:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c8dc7540 going to sleep for 11 seconds 00000100:00100000:1.0:1790710702.347734:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176990464 00000100:00100000:1.0:1790710702.347739:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176990464 00000100:00100000:1.0:1790710702.347773:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1790710702.347780:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c64ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+15:5842:x1877696176990464:12345-0@lo:501: 00000100:00100000:1.0:1790710702.347985:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c64ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+15:5842:x1877696176990464:12345-0@lo:501: Request processed in 204us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710702.347992:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1790710702.348040:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f8ce6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696176990464:0@lo:501: 00000100:00100000:1.0:1790710702.348065:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c812c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696176990592:0@lo:503: 00000100:00100000:1.0:1790710702.348098:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710702.348112:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c5349900 going to sleep for 11 seconds 00000100:00100000:1.0:1790710702.348124:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176990592 00000100:00100000:1.0:1790710702.348150:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176990592 00000100:00100000:1.0:1790710702.348171:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1790710702.348183:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c64ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+15:5842:x1877696176990592:12345-0@lo:503: 00000100:00100000:1.0:1790710702.348442:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c64ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+15:5842:x1877696176990592:12345-0@lo:503: Request processed in 258us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710702.348449:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1790710702.348485:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c812c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696176990592:0@lo:503: 00000100:00100000:1.0:1790710702.348635:0:7020:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c812c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d27fc27-b651-404a-bd8c-b798806fb18a:7020:1877696176990720:0@lo:502: 00000100:00100000:1.0:1790710702.348665:0:7020:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710702.348683:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176990720 00000100:00100000:1.0:1790710702.348686:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176990720 00000100:00100000:1.0:1790710702.348704:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1790710702.348710:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c64ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+15:7020:x1877696176990720:12345-0@lo:502: 00000100:00100000:1.0:1790710702.348873:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c64ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+15:7020:x1877696176990720:12345-0@lo:502: Request processed in 163us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710702.348880:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1790710702.348906:0:7020:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f01e6480 going to sleep for 11 seconds 00000100:00100000:1.0:1790710702.348917:0:7020:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c812c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d27fc27-b651-404a-bd8c-b798806fb18a:7020:1877696176990720:0@lo:502: 00000020:01000000:1.0:1790710702.348937:0:7020:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1790710702.348943:0:7020:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1790710702.348949:0:7020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790710702.348951:0:7020:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1790710702.348955:0:7020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1790710702.348958:0:7020:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.146@tcp to nid 0x20000c0a8ce92 (192.168.206.146@tcp) 00000020:01000000:1.0:1790710702.348977:0:7020:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1790710702.348980:0:7020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790710702.348993:0:7020:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9c51c81b8000) 00000020:00000080:1.0:1790710702.349023:0:7020:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1790710702.349029:0:7020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1790710702.349097:0:7020:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1790710702.349102:0:7020:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:1.0:1790710702.349108:0:7020:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcbad34b281570bc1 00010000:00080000:1.0:1790710702.349157:0:7020:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c51f4bc6000@lustre-OST0000-osc-MDT0000: add connection 192.168.206.146@tcp at head 00010000:00010000:1.0:1790710702.349367:0:7020:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1790710702.484608:0:7020:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1790710702.484631:0:7020:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1790710702.485625:0:7020:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790710702.485782:0:7020:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790710702.485828:0:7020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1790710702.487014:0:7020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1790710702.488177:0:7025:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790710702.488184:0:7025:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1790710702.495408:0:7020:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1790710702.495420:0:7020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1790710702.495452:0:7020:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1790710702.495649:0:7020:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcbad34b281570bc8 00000100:00080000:2.0:1790710702.495660:0:7020:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790710702.495670:0:7020:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c51f4bc6000 using connection 192.168.206.146@tcp/0@lo 00000100:00100000:2.0:1790710702.495700:0:7020:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c51c8e8ca80 x1877696176990848/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790710702.495723:0:7020:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1790710702.495776:0:7020:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790710702.495779:0:7020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790710702.495781:0:7020:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1790710702.495784:0:7020:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790710702.495787:0:7020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790710702.495788:0:7020:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:2.0:1790710702.495791:0:7020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1790710702.495793:0:7020:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1790710702.495815:0:7020:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c8e8f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d27fc27-b651-404a-bd8c-b798806fb18a:7020:1877696176990976:0@lo:502: 00000100:00100000:3.0:1790710702.496031:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c8e8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1877696176990848:0@lo:8: 00000100:00100000:3.0:1790710702.496075:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710702.496144:0:6696:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176990848 00000100:00100000:3.0:1790710702.496150:0:6696:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176990848 00000100:00100000:3.0:1790710702.496174:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790710702.496180:0:6696:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f8ce7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3308:x1877696176990848:12345-0@lo:8: 00010000:00080000:3.0:1790710702.496199:0:6696:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 179 last 0 00000020:00000080:3.0:1790710702.496220:0:6696:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcbad34b281570bcf 00002000:00100000:3.0:1790710702.496244:0:6696:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9c51ff481000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1790710702.496249:0:6696:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:3.0:1790710702.496252:0:6696:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1790710702.496402:0:6696:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1790710702.496509:0:6696:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1790710702.496531:0:6696:0:(import.c:65:import_set_state_nolock()) ffff9c51ff480000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790710702.496574:0:6696:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f8ce7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1877696176990848:12345-0@lo:8: Request processed in 393us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710702.496581:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1790710702.496614:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c51c8e8ca80 x1877696176990848/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790710712 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790710702.496624:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790710702.496630:0:3308:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1790710702.496636:0:3308:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1790710702.496639:0:3308:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1790710702.496642:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9c51f4bc6000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1790710702.496649:0:3308:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1790710702.496653:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c8e8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1877696176990848:0@lo:8: 00000004:00080000:3.0:1790710702.496673:0:7025:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1790710702.496760:0:7025:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 179833632181ns, next at 0ns, rc = 0 00000100:00100000:2.0:1790710702.496996:0:7020:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710702.497033:0:7020:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c300dc00 going to sleep for 11 seconds 00000100:00100000:2.0:1790710702.497086:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176990976 00000100:00100000:2.0:1790710702.497089:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176990976 00000100:00100000:2.0:1790710702.497114:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1790710702.497119:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c64ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+15:7020:x1877696176990976:12345-0@lo:502: 00000100:00100000:2.0:1790710702.497949:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c64ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+15:7020:x1877696176990976:12345-0@lo:502: Request processed in 827us (950us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710702.497958:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1790710702.498016:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c8e8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877696176991104:0@lo:400: 00000100:00100000:2.0:1790710702.498045:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710702.498080:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c8e8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1877696176991232:0@lo:400: 00000100:00100000:2.0:1790710702.498102:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710702.498156:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176991104 00000100:00100000:2.0:1790710702.498161:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176991104 00000100:00100000:2.0:1790710702.498184:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176991232 00000100:00100000:2.0:1790710702.498186:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176991232 00000100:00100000:2.0:1790710702.498198:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790710702.498203:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8e8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1877696176991104:12345-0@lo:400: 00000100:00100000:2.0:1790710702.498238:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8e8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1877696176991104:12345-0@lo:400: Request processed in 34us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710702.498252:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790710702.498263:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790710702.498268:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8e8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1877696176991232:12345-0@lo:400: 00000100:00100000:2.0:1790710702.498505:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8e8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1877696176991232:12345-0@lo:400: Request processed in 236us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710702.498512:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1790710702.498547:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c51c8e8d180 x1877696176991104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790710718 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790710702.498558:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c8e8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877696176991104:0@lo:400: 00010000:00080000:2.0:1790710702.498578:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c51c8e8d880 x1877696176991232/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790710718 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790710702.498587:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c8e8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1877696176991232:0@lo:400: 00000100:00100000:2.0:1790710702.498607:0:7020:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c8e8f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d27fc27-b651-404a-bd8c-b798806fb18a:7020:1877696176990976:0@lo:502: 00000020:01000000:2.0:1790710702.498632:0:7020:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790710702.498638:0:7020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790710702.498640:0:7020:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:2.0:1790710702.498644:0:7020:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:2.0:1790710702.502485:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1790710702.502514:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.146@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1790710702.502524:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c520216a600/0xcbad34b281570bac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570bb3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710702.502535:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.146@tcp lock: ffff9c520216a600/0xcbad34b281570bac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570bb3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790710702.502544:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1790710702.502554:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9c51d02d19c0 from 1 10000000:01000000:2.0:1790710702.502557:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1790710702.502589:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c8046c00/0xcbad34b281570bd6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710702.502598:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.146@tcp lock: ffff9c51c8046c00/0xcbad34b281570bd6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710702.502610:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.146@tcp lock: ffff9c51c8046c00/0xcbad34b281570bd6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710702.502631:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c8e8f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696176991360:0@lo:101: 00000100:00100000:2.0:1790710702.502692:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710702.502729:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c300dc00 going to sleep for 11 seconds 00000100:00100000:2.0:1790710702.502751:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176991360 00000100:00100000:2.0:1790710702.502758:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176991360 00000100:00100000:2.0:1790710702.502797:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1790710702.502806:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c64e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+15:5842:x1877696176991360:12345-0@lo:101: 00010000:00010000:2.0:1790710702.502819:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790710702.502830:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c51c8046200/0xcbad34b281570bdd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbad34b281570bd6 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710702.503936:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c51c8046200/0xcbad34b281570bdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbad34b281570bd6 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710702.503951:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c51c8046200/0xcbad34b281570bdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281570bd6 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710702.503959:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c8046200, rc 0) 00000100:00100000:2.0:1790710702.504025:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c64e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+16:5842:x1877696176991360:12345-0@lo:101: Request processed in 1220us (1331us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710702.504038:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1790710702.504090:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c8e8f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696176991360:0@lo:101: 00010000:00010000:2.0:1790710702.504104:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.146@tcp lock: ffff9c51c8046c00/0xcbad34b281570bd6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570bdd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710702.504114:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.146@tcp lock: ffff9c51c8046c00/0xcbad34b281570bd6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbad34b281570bdd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710702.504183:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c8e8f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696176991488:0@lo:501: 00000100:00100000:2.0:1790710702.504211:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710702.504234:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c300dc00 going to sleep for 11 seconds 00000100:00100000:2.0:1790710702.504249:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176991488 00000100:00100000:2.0:1790710702.504254:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176991488 00000100:00100000:2.0:1790710702.504918:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1790710702.504927:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c64e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+16:5842:x1877696176991488:12345-0@lo:501: 00000100:00100000:2.0:1790710702.505077:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c64e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+16:5842:x1877696176991488:12345-0@lo:501: Request processed in 151us (865us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790710702.505084:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1790710702.505116:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c8e8f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696176991488:0@lo:501: 10000000:01000000:2.0:1790710702.505154:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.146@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1790710702.505160:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c8046c00/0xcbad34b281570bd6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570bdd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710702.505169:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.146@tcp lock: ffff9c51c8046c00/0xcbad34b281570bd6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570bdd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790710702.567356:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:0.0:1790710702.601593:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1790710702.636830:0:7026:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1790710702.636867:0:7026:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c812df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7026:1877696176991744:0@lo:7: 00000100:00100000:1.0:1790710702.636930:0:7026:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710702.636973:0:7026:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51ff9f9c00 going to sleep for 11 seconds 00000100:00100000:1.0:1790710702.636987:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c812c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1877696176991616:0@lo:13: 00000100:00100000:1.0:1790710702.637022:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710702.637062:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176991744 00000100:00100000:1.0:1790710702.637069:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176991744 00000100:00100000:1.0:1790710702.637110:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790710702.637117:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c812ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7026:x1877696176991744:12345-0@lo:7: 00000100:00100000:2.0:1790710702.638193:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176991616 00000100:00100000:2.0:1790710702.638205:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176991616 00000100:00100000:2.0:1790710702.638241:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790710702.638248:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c812fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1877696176991616:12345-0@lo:13: 00002000:00000024:2.0:1790710702.638270:0:6699:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1790710702.638328:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c812fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1877696176991616:12345-0@lo:13: Request processed in 80us (1304us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710702.638335:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1790710702.641292:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790710702.641356:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c51c812c700 x1877696176991616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790710718 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790710702.641380:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c812c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1877696176991616:0@lo:13: 00002000:00080000:1.0:1790710702.655989:0:6698:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1790710702.655997:0:6698:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1790710702.657332:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c812ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7026:x1877696176991744:12345-0@lo:7: Request processed in 20208us (20395us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710702.657349:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1790710702.657986:0:7026:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c51c812df80 x1877696176991744/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790710718 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790710702.658012:0:7026:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c812df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7026:1877696176991744:0@lo:7: 00000004:00080000:2.0:1790710702.658027:0:7026:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1790710702.658064:0:7026:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c8e8f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7026:1877696176991872:0@lo:5: 00000100:00100000:2.0:1790710702.658108:0:7026:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710702.658836:0:7026:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c300dc00 going to sleep for 11 seconds 00000100:00100000:3.0:1790710702.659811:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176991872 00000100:00100000:3.0:1790710702.659820:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176991872 00000100:00100000:3.0:1790710702.660751:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790710702.660764:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8e8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7026:x1877696176991872:12345-0@lo:5: 00002000:00080000:3.0:1790710702.660796:0:6697:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1790710702.660800:0:6697:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1790710702.661164:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8e8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7026:x1877696176991872:12345-0@lo:5: Request processed in 402us (3054us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1790710702.661172:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1790710702.661306:0:7026:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c51c8e8f100 x1877696176991872/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790710718 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790710702.661322:0:7026:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c8e8f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7026:1877696176991872:0@lo:5: 00000004:00080000:2.0:1790710702.661333:0:7026:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1790710702.661364:0:7026:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c8e8d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7026:1877696176992000:0@lo:700: 00000100:00100000:2.0:1790710702.661396:0:7026:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710702.661414:0:7026:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c300dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1790710702.663394:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176992000 00000100:00100000:0.0:1790710702.663406:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176992000 00000100:00100000:0.0:1790710702.663451:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790710702.663460:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8e8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7026:x1877696176992000:12345-0@lo:700: 00000100:00100000:0.0:1790710702.663508:0:6704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9575880 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6704:1877696176992128:0@lo:700: 00000100:00100000:0.0:1790710702.663560:0:6704:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710702.663592:0:6704:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f979a900 going to sleep for 11 seconds 00000100:00100000:0.0:1790710702.663759:0:5852:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176992128 00000100:00100000:0.0:1790710702.663763:0:5852:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176992128 00000100:00100000:0.0:1790710702.663788:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790710702.663794:0:5852:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9576680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6704:x1877696176992128:12345-0@lo:700: 40000000:02000000:0.0:1790710702.723471:0:5852:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:0.0:1790710702.731653:0:5852:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9576680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6704:x1877696176992128:12345-0@lo:700: Request processed in 67852us (68085us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710702.731666:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1790710702.731823:0:6704:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c51f9575880 x1877696176992128/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1790710718 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790710702.731837:0:6704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9575880 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6704:1877696176992128:0@lo:700: 40000000:02000000:1.0:1790710702.731965:0:6704:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:02000400:2.0:1790710702.844041:0:7066:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg646-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1790710702.844469:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8e8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7026:x1877696176992000:12345-0@lo:700: Request processed in 181005us (183068us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710702.844487:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000001:00080000:3.0:1790710702.844534:0:6720:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:3.0:1790710702.844542:0:6720:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:0.0:1790710702.847224:0:7026:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c51c8e8d180 x1877696176992000/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1790710718 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790710702.847257:0:7026:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c8e8d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7026:1877696176992000:0@lo:700: 00000004:02000040:2.0:1790710702.925314:0:7026:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:1.0:1790710702.938204:0:7026:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c812d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7026:1877696176992256:0@lo:5: 00000100:00100000:1.0:1790710702.938267:0:7026:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710702.938308:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176992256 00000100:00100000:1.0:1790710702.938314:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176992256 00000100:00100000:1.0:1790710702.938356:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790710702.938363:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c812ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7026:x1877696176992256:12345-0@lo:5: 00000100:00100000:0.0:1790710702.943229:0:7026:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51ff9f9c00 going to sleep for 11 seconds 00002000:00080000:1.0:1790710702.950542:0:6698:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1790710702.950561:0:6698:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:1.0:1790710702.957533:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c812ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7026:x1877696176992256:12345-0@lo:5: Request processed in 19164us (19260us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1790710702.957546:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1790710702.958778:0:7026:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c51c812d500 x1877696176992256/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790710718 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790710702.958793:0:7026:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1790710702.958807:0:7026:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9c51c812d500 x1877696176992256/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790710718 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790710702.958818:0:7026:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c812d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7026:1877696176992256:0@lo:5: 00000004:00080000:0.0:1790710702.958832:0:7026:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:2.0:1790710703.623394:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790710704.653497:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710705.671699:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790710706.697110:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1790710707.656360:0:6720:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1790710707.726205:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790710707.975459:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9577800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1877696176992384:0@lo:13: 00000100:00100000:1.0:1790710707.975536:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710707.976066:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176992384 00000100:00100000:0.0:1790710707.976075:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176992384 00000100:00100000:0.0:1790710707.976122:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790710707.976791:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f8ce5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1877696176992640:0@lo:400: 00000100:00100000:0.0:1790710707.976805:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c812f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877696176992384:12345-0@lo:13: 00000100:00100000:1.0:1790710707.976838:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710707.976866:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790710707.976873:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f8ce4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1877696176992768:0@lo:400: 00000100:00100000:2.0:1790710707.976889:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f8ce6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d27fc27-b651-404a-bd8c-b798806fb18a:3310:1877696176992512:0@lo:400: 00000100:00100000:1.0:1790710707.976899:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710707.976937:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1790710707.976960:0:6699:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790710707.977008:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176992640 00000100:00100000:2.0:1790710707.977013:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176992640 00000100:00100000:3.0:1790710707.977019:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176992768 00000100:00100000:0.0:1790710707.977020:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c812f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877696176992384:12345-0@lo:13: Request processed in 228us (1482us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710707.977024:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176992768 00000100:00100000:0.0:1790710707.977028:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790710707.977049:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1790710707.977051:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790710707.977055:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1790710707.977056:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790710707.977060:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c812df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1877696176992640:12345-0@lo:400: 00000100:00100000:3.0:1790710707.977067:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c812c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1877696176992768:12345-0@lo:400: 00000100:00100000:2.0:1790710707.977120:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c812df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1877696176992640:12345-0@lo:400: Request processed in 62us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710707.977148:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790710707.977177:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176992512 00000100:00100000:2.0:1790710707.977181:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176992512 00000100:00100000:2.0:1790710707.977213:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1790710707.977222:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c64e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+16:3310:x1877696176992512:12345-0@lo:400: 00000100:00100000:2.0:1790710707.977272:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c64e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+16:3310:x1877696176992512:12345-0@lo:400: Request processed in 52us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710707.977280:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:1.0:1790710707.977296:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c51f9577800 x1877696176992384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790710723 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790710707.977307:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1790710707.977328:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f8ce6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d27fc27-b651-404a-bd8c-b798806fb18a:3310:1877696176992512:0@lo:400: 00000100:00100000:1.0:1790710707.977330:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9577800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1877696176992384:0@lo:13: 00000100:00100000:3.0:1790710707.977585:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c812c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1877696176992768:12345-0@lo:400: Request processed in 450us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710707.977656:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1790710707.978538:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c51f8ce4a80 x1877696176992768/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790710723 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790710707.978551:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f8ce4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1877696176992768:0@lo:400: 00010000:00080000:2.0:1790710707.978562:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c51f8ce5f80 x1877696176992640/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790710723 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790710707.978569:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f8ce5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1877696176992640:0@lo:400: 00010000:00010000:0.0:1790710708.743638:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710709.772445:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710710.802246:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710711.816732:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710712.842118:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790710713.095754:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790710713.095778:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9576300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1877696176992896:0@lo:13: 00000100:00100000:0.0:1790710713.095840:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710713.095907:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176992896 00000100:00100000:2.0:1790710713.095917:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176992896 00000100:00100000:2.0:1790710713.095989:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790710713.095999:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9576a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877696176992896:12345-0@lo:13: 00002000:00000024:2.0:1790710713.096030:0:6699:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790710713.096075:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9576a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877696176992896:12345-0@lo:13: Request processed in 77us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710713.096082:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1790710713.096223:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790710713.096260:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c51f9576300 x1877696176992896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790710729 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790710713.096278:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9576300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1877696176992896:0@lo:13: 00000100:00100000:2.0:1790710713.105976:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9576300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d27fc27-b651-404a-bd8c-b798806fb18a:3310:1877696176993024:0@lo:400: 00000100:00100000:2.0:1790710713.106044:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710713.106175:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9574000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1877696176993152:0@lo:400: 00000100:00100000:0.0:1790710713.106206:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710713.106232:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790710713.106239:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9575c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1877696176993280:0@lo:400: 00000100:00100000:0.0:1790710713.106261:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710713.106294:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176993152 00000100:00100000:0.0:1790710713.106301:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176993152 00000100:00100000:3.0:1790710713.106486:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176993024 00000100:00100000:3.0:1790710713.106490:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176993024 00000100:00100000:3.0:1790710713.106521:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1790710713.106530:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c64e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+16:3310:x1877696176993024:12345-0@lo:400: 00000100:00100000:0.0:1790710713.106594:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176993280 00000100:00100000:0.0:1790710713.106598:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176993280 00000100:00100000:0.0:1790710713.106624:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790710713.106630:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9574700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1877696176993152:12345-0@lo:400: 00000100:00100000:0.0:1790710713.106666:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9574700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1877696176993152:12345-0@lo:400: Request processed in 35us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710713.106672:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790710713.106687:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790710713.106692:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9575f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1877696176993280:12345-0@lo:400: 00000100:00100000:0.0:1790710713.106715:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9575f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1877696176993280:12345-0@lo:400: Request processed in 23us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710713.106721:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1790710713.106745:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1790710713.106768:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c51f9575c00 x1877696176993280/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790710729 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790710713.106781:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9575c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1877696176993280:0@lo:400: 00010000:00080000:0.0:1790710713.106817:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c51f9574000 x1877696176993152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790710729 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790710713.106825:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9574000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1877696176993152:0@lo:400: 00000100:00100000:3.0:1790710713.110691:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c64e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+16:3310:x1877696176993024:12345-0@lo:400: Request processed in 4155us (4640us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710713.110712:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1790710713.113933:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9576300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d27fc27-b651-404a-bd8c-b798806fb18a:3310:1877696176993024:0@lo:400: 00010000:00010000:3.0:1790710713.863811:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1790710713.983461:0:7626:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1790710713.983465:0:7626:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1790710713.984199:0:7626:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c51ff4b3000 00000020:01000004:2.0:1790710713.984217:0:7626:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1790710713.984230:0:7626:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1790710713.984244:0:7626:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9c51ff4ab380) 00000020:00000080:2.0:1790710713.984262:0:7626:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1790710714.009120:0:7626:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1790710714.010695:0:7626:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1790710714.029340:0:7626:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1790710714.033737:0:7626:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1790710714.033771:0:7626:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1790710714.033961:0:7626:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1790710714.033994:0:7626:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1790710714.034398:0:7626:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1790710714.034410:0:7626:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:0.0:1790710714.034419:0:7626:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xcbad34b281570beb 00000020:01000004:0.0:1790710714.034425:0:7626:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:0.0:1790710714.034444:0:7626:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.146@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1790710714.034447:0:7626:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.146@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1790710714.034453:0:7626:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1790710714.034470:0:7626:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:0.0:1790710714.034474:0:7626:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.146@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1790710714.053203:0:7626:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.146@tcp ctxt 0 is initialized 00000020:01000004:0.0:1790710714.053241:0:7626:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.146@tcp, index=0001, flags=0x20062 00000020:01000004:0.0:1790710714.053244:0:7626:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1790710714.053246:0:7626:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790710714.053247:0:7626:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790710714.053248:0:7626:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790710714.053250:0:7626:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790710714.053251:0:7626:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790710714.053252:0:7626:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790710714.053254:0:7626:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790710714.053255:0:7626:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790710714.053257:0:7626:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790710714.053263:0:7626:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1790710714.053266:0:7626:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:0.0:1790710714.053268:0:7626:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790710714.053269:0:7626:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790710714.053270:0:7626:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790710714.053271:0:7626:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790710714.053272:0:7626:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790710714.053273:0:7626:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790710714.053274:0:7626:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790710714.053275:0:7626:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790710714.053276:0:7626:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790710714.053277:0:7626:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790710714.053278:0:7626:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1790710714.053311:0:7626:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1790710714.053331:0:7626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9574000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:7626:1877696176993408:0@lo:253: 00000100:00100000:0.0:1790710714.053397:0:7626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710714.053499:0:7626:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51e03110c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790710714.053645:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176993408 00000100:00100000:2.0:1790710714.053653:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176993408 00000100:00100000:2.0:1790710714.053705:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1790710714.053714:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c64e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+16:7626:x1877696176993408:12345-0@lo:253: 20000000:01000000:2.0:1790710714.053743:0:5838:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1790710714.053747:0:5838:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1790710714.053751:0:5838:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1790710714.053754:0:5838:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:2.0:1790710714.059414:0:5838:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790710714.059634:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1790710714.059650:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:2.0:1790710714.059689:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1790710714.059698:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:2.0:1790710714.059728:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1790710714.059780:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1790710714.060596:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1790710714.060617:0:5838:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.146@tcp 20000000:01000000:2.0:1790710714.060619:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.146@tcp (null) (null) (null) 00000040:00080000:2.0:1790710714.060652:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1790710714.060658:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1790710714.060694:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1790710714.060700:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.206.146@tcp (null) (null) 00000040:00080000:2.0:1790710714.060723:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1790710714.060730:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1790710714.060752:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1790710714.060873:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1790710714.063330:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:2.0:1790710714.063359:0:5838:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.146@tcp 20000000:01000000:2.0:1790710714.063361:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.146@tcp (null) (null) (null) 00000040:00080000:2.0:1790710714.063414:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:2.0:1790710714.063421:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1790710714.063449:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:2.0:1790710714.063456:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.206.146@tcp (null) (null) 00000040:00080000:2.0:1790710714.063489:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:2.0:1790710714.063498:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1790710714.063547:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:2.0:1790710714.063583:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:2.0:1790710714.063600:0:5838:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:2.0:1790710714.063603:0:5838:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1790710714.063612:0:5838:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1790710714.063624:0:5838:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1790710714.063627:0:5838:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1790710714.063665:0:5838:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1790710714.063668:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1790710714.071755:0:7628:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1790710714.071863:0:7628:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1790710714.071902:0:7628:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:3.0:1790710714.072462:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:3.0:1790710714.072508:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:3.0:1790710714.072563:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:3.0:1790710714.072578:0:5838:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1790710714.072580:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1790710714.073742:0:7629:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1790710714.074387:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1790710714.074422:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1790710714.074573:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:3.0:1790710714.074587:0:5838:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1790710714.074589:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1790710714.075798:0:7630:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:1.0:1790710714.075862:0:7630:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:1.0:1790710714.075921:0:7630:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1790710714.076385:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1790710714.076425:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1790710714.076570:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1790710714.076585:0:5838:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1790710714.076587:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1790710714.077841:0:7631:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 16 1->4: lustre sys.timeout 20000000:01000000:1.0:1790710714.077906:0:7631:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 16 2->4: lustre sys.timeout 00000040:00080000:1.0:1790710714.077968:0:7631:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1790710714.078649:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:3.0:1790710714.078690:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:3.0:1790710714.078718:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:3.0:1790710714.078733:0:5838:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:3.0:1790710714.078735:0:5838:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:3.0:1790710714.078743:0:5838:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1790710714.078760:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c51c13fd000/0xcbad34b281570bf2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710714.078776:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c520216ba00/0xcbad34b281570b43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281570b3c expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710714.078860:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c51c1644e00/0xcbad34b281570b6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281570b66 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710714.078880:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c520216a000/0xcbad34b281570b97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281570b90 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710714.078886:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c520216b600/0xcbad34b281570bb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281570bac expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710714.078893:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c51c8046200/0xcbad34b281570bdd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281570bd6 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710714.078900:0:5838:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c51c13fd000/0xcbad34b281570bf2 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710714.078952:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c51c8046200/0xcbad34b281570bdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbad34b281570bd6 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710714.078969:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c51c8046200/0xcbad34b281570bdd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbad34b281570bd6 expref: 16 pid: 5837 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710714.078983:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f8ce5880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5838:1877696176993536:0@lo:104: 00000100:00100000:3.0:1790710714.079272:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790710714.079363:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c520216b600/0xcbad34b281570bb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbad34b281570bac expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710714.079372:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c520216b600/0xcbad34b281570bb3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbad34b281570bac expref: 16 pid: 5837 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710714.079381:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f8ce6d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5838:1877696176993664:0@lo:104: 00010000:00010000:3.0:1790710714.079405:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c520216a000/0xcbad34b281570b97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbad34b281570b90 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710714.079424:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c520216a000/0xcbad34b281570b97 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbad34b281570b90 expref: 16 pid: 5840 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710714.079433:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f8ce5500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5838:1877696176993792:0@lo:104: 00010000:00010000:3.0:1790710714.079466:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c51c1644e00/0xcbad34b281570b6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbad34b281570b66 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710714.079474:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c51c1644e00/0xcbad34b281570b6d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbad34b281570b66 expref: 16 pid: 5838 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710714.079482:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f8ce4e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5838:1877696176993920:0@lo:104: 00010000:00010000:3.0:1790710714.079504:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c520216ba00/0xcbad34b281570b43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbad34b281570b3c expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710714.079512:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c520216ba00/0xcbad34b281570b43 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbad34b281570b3c expref: 16 pid: 5840 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710714.079520:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f8ce4700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5838:1877696176994048:0@lo:104: 00000100:00100000:3.0:1790710714.079538:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f9b2db40 going to sleep for 11 seconds 00000100:00100000:1.0:1790710714.079742:0:5827:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1790710714.079761:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710714.079894:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710714.079956:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710714.079975:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176993536 00000100:00100000:0.0:1790710714.079982:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176993536 00000100:00100000:0.0:1790710714.080025:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176993664 00000100:00100000:0.0:1790710714.080028:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176993664 00000100:00100000:0.0:1790710714.080038:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176993792 00000100:00100000:0.0:1790710714.080041:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176993792 00000100:00100000:0.0:1790710714.080053:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790710714.080061:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c7a8f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5d27fc27-b651-404a-bd8c-b798806fb18a+5:5838:x1877696176993536:12345-0@lo:104: 00010000:00010000:0.0:1790710714.080074:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.146@tcp lock: ffff9c51c8046c00/0xcbad34b281570bd6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbad34b281570bdd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710714.080338:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790710714.080345:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c7a8f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5d27fc27-b651-404a-bd8c-b798806fb18a+5:5838:x1877696176993536:12345-0@lo:104: Request processed in 285us (1074us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710714.080352:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790710714.080392:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790710714.080399:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c812d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5d27fc27-b651-404a-bd8c-b798806fb18a+4:5838:x1877696176993664:12345-0@lo:104: 00010000:00010000:0.0:1790710714.080415:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.146@tcp lock: ffff9c520216a600/0xcbad34b281570bac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbad34b281570bb3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710714.080453:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1790710714.080458:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c812d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5d27fc27-b651-404a-bd8c-b798806fb18a+4:5838:x1877696176993664:12345-0@lo:104: Request processed in 61us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710714.080464:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790710714.080478:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790710714.080484:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c812dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5d27fc27-b651-404a-bd8c-b798806fb18a+3:5838:x1877696176993792:12345-0@lo:104: 00010000:00010000:0.0:1790710714.080492:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.146@tcp lock: ffff9c51c1645200/0xcbad34b281570b90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbad34b281570b97 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710714.080518:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1790710714.080522:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c812dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5d27fc27-b651-404a-bd8c-b798806fb18a+3:5838:x1877696176993792:12345-0@lo:104: Request processed in 40us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710714.080527:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1790710714.080543:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1790710714.080549:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.146@tcp lock: ffff9c51c8046c00/0xcbad34b281570bd6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbad34b281570bdd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710714.080556:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c8046c00 already unused, calling callback (ffffffffc1cdfc20) 10000000:00010000:0.0:1790710714.080559:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.146@tcp lock: ffff9c51c8046c00/0xcbad34b281570bd6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbad34b281570bdd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710714.080567:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.146@tcp lock: ffff9c51c8046c00/0xcbad34b281570bd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbad34b281570bdd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790710714.080574:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.146@tcp lock: ffff9c51c8046c00/0xcbad34b281570bd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbad34b281570bdd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790710714.080586:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790710714.080617:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.146@tcp lock: ffff9c51c8046c00/0xcbad34b281570bd6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281570bdd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710714.080624:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790710714.080640:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.146@tcp lock: ffff9c51c8046c00/0xcbad34b281570bd6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281570bdd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710714.080647:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.146@tcp lock: ffff9c51c8046c00/0xcbad34b281570bd6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281570bdd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710714.080663:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790710714.080666:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.146@tcp lock: ffff9c520216a600/0xcbad34b281570bac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbad34b281570bb3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710714.080672:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c520216a600 already unused, calling callback (ffffffffc1cdfc20) 10000000:00010000:0.0:1790710714.080674:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.146@tcp lock: ffff9c520216a600/0xcbad34b281570bac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbad34b281570bb3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710714.080681:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.146@tcp lock: ffff9c520216a600/0xcbad34b281570bac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbad34b281570bb3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790710714.080686:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.146@tcp lock: ffff9c520216a600/0xcbad34b281570bac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbad34b281570bb3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790710714.080692:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790710714.080703:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.146@tcp lock: ffff9c520216a600/0xcbad34b281570bac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281570bb3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710714.080708:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790710714.080720:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.146@tcp lock: ffff9c520216a600/0xcbad34b281570bac lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281570bb3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710714.080727:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.146@tcp lock: ffff9c520216a600/0xcbad34b281570bac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281570bb3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710714.080750:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790710714.080753:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.146@tcp lock: ffff9c51c1645200/0xcbad34b281570b90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbad34b281570b97 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710714.080758:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c1645200 already unused, calling callback (ffffffffc1cdfc20) 10000000:00010000:0.0:1790710714.080761:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.146@tcp lock: ffff9c51c1645200/0xcbad34b281570b90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbad34b281570b97 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710714.080767:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.146@tcp lock: ffff9c51c1645200/0xcbad34b281570b90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbad34b281570b97 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790710714.080772:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.146@tcp lock: ffff9c51c1645200/0xcbad34b281570b90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbad34b281570b97 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790710714.080777:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790710714.080898:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790710714.080975:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.146@tcp lock: ffff9c51c1645200/0xcbad34b281570b90 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281570b97 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710714.080981:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790710714.081068:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.146@tcp lock: ffff9c51c1645200/0xcbad34b281570b90 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281570b97 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710714.081076:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.146@tcp lock: ffff9c51c1645200/0xcbad34b281570b90 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281570b97 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710714.081234:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790710714.081242:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790710714.081244:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790710714.081267:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9576d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d27fc27-b651-404a-bd8c-b798806fb18a:3309:1877696176994176:0@lo:103: 00000100:00100000:0.0:1790710714.081306:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710714.081341:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790710714.081347:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9575c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d27fc27-b651-404a-bd8c-b798806fb18a:3309:1877696176994304:0@lo:103: 00000100:00100000:0.0:1790710714.081367:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710714.081389:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790710714.081396:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9574e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d27fc27-b651-404a-bd8c-b798806fb18a:3312:1877696176994432:0@lo:103: 00000100:00100000:0.0:1790710714.081429:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710714.081455:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176994176 00000100:00100000:0.0:1790710714.081460:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176994176 00010000:00010000:0.0:1790710714.081480:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c51c8046200/0xcbad34b281570bdd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbad34b281570bd6 expref: 17 pid: 5837 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710714.081495:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176994304 00000100:00100000:0.0:1790710714.081498:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176994304 00010000:00010000:0.0:1790710714.081508:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c520216b600/0xcbad34b281570bb3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbad34b281570bac expref: 18 pid: 5837 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710714.081518:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176994432 00000100:00100000:0.0:1790710714.081520:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176994432 00010000:00010000:0.0:1790710714.081529:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c520216a000/0xcbad34b281570b97 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbad34b281570b90 expref: 19 pid: 5840 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710714.081540:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790710714.081547:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9577b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d27fc27-b651-404a-bd8c-b798806fb18a+19:3309:x1877696176994176:12345-0@lo:103: 00010000:00010000:0.0:1790710714.081557:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790710714.081563:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c51c8046200/0xcbad34b281570bdd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbad34b281570bd6 expref: 19 pid: 5837 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710714.081586:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c51c8046200/0xcbad34b281570bdd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbad34b281570bd6 expref: 19 pid: 5837 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710714.081602:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790710714.081632:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9577b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d27fc27-b651-404a-bd8c-b798806fb18a+19:3309:x1877696176994176:12345-0@lo:103: Request processed in 85us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710714.081639:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790710714.081651:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790710714.081657:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9575500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d27fc27-b651-404a-bd8c-b798806fb18a+18:3309:x1877696176994304:12345-0@lo:103: 00010000:00010000:0.0:1790710714.081663:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790710714.081667:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c520216b600/0xcbad34b281570bb3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbad34b281570bac expref: 18 pid: 5837 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710714.081674:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c520216b600/0xcbad34b281570bb3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbad34b281570bac expref: 18 pid: 5837 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710714.081683:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790710714.081703:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9575500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d27fc27-b651-404a-bd8c-b798806fb18a+18:3309:x1877696176994304:12345-0@lo:103: Request processed in 47us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710714.081709:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790710714.081718:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790710714.081724:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9574a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d27fc27-b651-404a-bd8c-b798806fb18a+17:3312:x1877696176994432:12345-0@lo:103: 00010000:00010000:0.0:1790710714.081731:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790710714.081734:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c520216a000/0xcbad34b281570b97 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbad34b281570b90 expref: 17 pid: 5840 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710714.081742:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c520216a000/0xcbad34b281570b97 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbad34b281570b90 expref: 17 pid: 5840 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710714.081758:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790710714.081963:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c51c8046200/0xcbad34b281570bdd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbad34b281570bd6 expref: 17 pid: 5837 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710714.081975:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f8ce5880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5838:1877696176993536:0@lo:104: 00010000:00010000:3.0:1790710714.081987:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c520216b600/0xcbad34b281570bb3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbad34b281570bac expref: 16 pid: 5837 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710714.081996:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f8ce6d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5838:1877696176993664:0@lo:104: 00010000:00010000:3.0:1790710714.082028:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c520216a000/0xcbad34b281570b97 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbad34b281570b90 expref: 15 pid: 5840 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710714.082038:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f8ce5500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5838:1877696176993792:0@lo:104: 00000100:00100000:0.0:1790710714.082394:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9574a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d27fc27-b651-404a-bd8c-b798806fb18a+17:3312:x1877696176994432:12345-0@lo:103: Request processed in 62us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710714.082403:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790710714.082438:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9574e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d27fc27-b651-404a-bd8c-b798806fb18a:3312:1877696176994432:0@lo:103: 00000100:00100000:0.0:1790710714.082463:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9575c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d27fc27-b651-404a-bd8c-b798806fb18a:3309:1877696176994304:0@lo:103: 00000100:00100000:0.0:1790710714.082471:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9576d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d27fc27-b651-404a-bd8c-b798806fb18a:3309:1877696176994176:0@lo:103: 00000100:00100000:1.0:1790710714.082651:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710714.082704:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176993920 00000100:00100000:0.0:1790710714.082708:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176993920 00000100:00100000:0.0:1790710714.082729:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176994048 00000100:00100000:0.0:1790710714.082731:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176994048 00000100:00100000:0.0:1790710714.082739:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790710714.082744:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c812e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5d27fc27-b651-404a-bd8c-b798806fb18a+4:5838:x1877696176993920:12345-0@lo:104: 00010000:00010000:0.0:1790710714.082755:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.146@tcp lock: ffff9c51c1645a00/0xcbad34b281570b66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbad34b281570b6d expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710714.082896:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790710714.082906:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c812e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5d27fc27-b651-404a-bd8c-b798806fb18a+4:5838:x1877696176993920:12345-0@lo:104: Request processed in 157us (2945us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710714.082912:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790710714.082924:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790710714.082930:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c812f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5d27fc27-b651-404a-bd8c-b798806fb18a+3:5838:x1877696176994048:12345-0@lo:104: 00010000:00010000:0.0:1790710714.082938:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.146@tcp lock: ffff9c520216b000/0xcbad34b281570b3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbad34b281570b43 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710714.082981:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1790710714.082995:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c812f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5d27fc27-b651-404a-bd8c-b798806fb18a+3:5838:x1877696176994048:12345-0@lo:104: Request processed in 65us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710714.083001:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1790710714.083031:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790710714.083037:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.146@tcp lock: ffff9c51c1645a00/0xcbad34b281570b66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbad34b281570b6d expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710714.083044:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c1645a00 already unused, calling callback (ffffffffc1cdfc20) 10000000:00010000:0.0:1790710714.083047:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.146@tcp lock: ffff9c51c1645a00/0xcbad34b281570b66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbad34b281570b6d expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710714.083055:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.146@tcp lock: ffff9c51c1645a00/0xcbad34b281570b66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbad34b281570b6d expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790710714.083062:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.146@tcp lock: ffff9c51c1645a00/0xcbad34b281570b66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbad34b281570b6d expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790710714.083068:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790710714.083105:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.146@tcp lock: ffff9c51c1645a00/0xcbad34b281570b66 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281570b6d expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710714.083112:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790710714.083263:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.146@tcp lock: ffff9c51c1645a00/0xcbad34b281570b66 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281570b6d expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710714.083271:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.146@tcp lock: ffff9c51c1645a00/0xcbad34b281570b66 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281570b6d expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710714.083280:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790710714.083283:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.146@tcp lock: ffff9c520216b000/0xcbad34b281570b3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbad34b281570b43 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710714.083297:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c520216b000 already unused, calling callback (ffffffffc1cdfc20) 10000000:00010000:0.0:1790710714.083300:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.146@tcp lock: ffff9c520216b000/0xcbad34b281570b3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbad34b281570b43 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710714.083306:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.146@tcp lock: ffff9c520216b000/0xcbad34b281570b3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbad34b281570b43 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790710714.083311:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.146@tcp lock: ffff9c520216b000/0xcbad34b281570b3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbad34b281570b43 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790710714.083316:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790710714.083329:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.146@tcp lock: ffff9c520216b000/0xcbad34b281570b3c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281570b43 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710714.083336:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790710714.083347:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.146@tcp lock: ffff9c520216b000/0xcbad34b281570b3c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281570b43 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710714.083353:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.146@tcp lock: ffff9c520216b000/0xcbad34b281570b3c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281570b43 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710714.083367:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790710714.083369:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790710714.083370:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790710714.083377:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790710714.083388:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9576d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d27fc27-b651-404a-bd8c-b798806fb18a:3311:1877696176994560:0@lo:103: 00000100:00100000:0.0:1790710714.083416:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710714.083447:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790710714.083455:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9575c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d27fc27-b651-404a-bd8c-b798806fb18a:3310:1877696176994688:0@lo:103: 00000100:00100000:0.0:1790710714.083485:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710714.083509:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176994560 00000100:00100000:0.0:1790710714.083514:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176994560 00010000:00010000:0.0:1790710714.083529:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c51c1644e00/0xcbad34b281570b6d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbad34b281570b66 expref: 14 pid: 5838 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710714.083547:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176994688 00000100:00100000:0.0:1790710714.083550:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176994688 00010000:00010000:0.0:1790710714.083559:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c520216ba00/0xcbad34b281570b43 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbad34b281570b3c expref: 15 pid: 5840 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710714.083570:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790710714.083575:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9574e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d27fc27-b651-404a-bd8c-b798806fb18a+15:3311:x1877696176994560:12345-0@lo:103: 00010000:00010000:0.0:1790710714.083584:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790710714.083589:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c51c1644e00/0xcbad34b281570b6d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbad34b281570b66 expref: 15 pid: 5838 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710714.083598:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c51c1644e00/0xcbad34b281570b6d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbad34b281570b66 expref: 15 pid: 5838 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710714.083612:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790710714.083638:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9574e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d27fc27-b651-404a-bd8c-b798806fb18a+15:3311:x1877696176994560:12345-0@lo:103: Request processed in 63us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710714.083643:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790710714.083653:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790710714.083658:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9577100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d27fc27-b651-404a-bd8c-b798806fb18a+14:3310:x1877696176994688:12345-0@lo:103: 00010000:00010000:0.0:1790710714.083665:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790710714.083669:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c520216ba00/0xcbad34b281570b43 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbad34b281570b3c expref: 14 pid: 5840 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710714.083686:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c520216ba00/0xcbad34b281570b43 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbad34b281570b3c expref: 14 pid: 5840 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710714.083697:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c51c13fd000/0xcbad34b281570bf2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710714.083704:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c51c13fd000/0xcbad34b281570bf2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710714.083718:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c51c13fd000/0xcbad34b281570bf2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710714.083725:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c51c13fd000/0xcbad34b281570bf2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710714.083731:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c51c13fd000/0xcbad34b281570bf2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710714.083737:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c51c13fd000/0xcbad34b281570bf2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710714.083743:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c13fd000 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:0.0:1790710714.083747:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c51c13fd000/0xcbad34b281570bf2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710714.083755:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c51c13fd000/0xcbad34b281570bf2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710714.083762:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c51c13fd000/0xcbad34b281570bf2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710714.083782:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790710714.083949:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790710714.084120:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9577100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d27fc27-b651-404a-bd8c-b798806fb18a+14:3310:x1877696176994688:12345-0@lo:103: Request processed in 461us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710714.084154:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790710714.084191:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9576d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d27fc27-b651-404a-bd8c-b798806fb18a:3311:1877696176994560:0@lo:103: 00010000:00010000:3.0:1790710714.084417:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c51c1644e00/0xcbad34b281570b6d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbad34b281570b66 expref: 13 pid: 5838 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710714.084428:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f8ce4e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5838:1877696176993920:0@lo:104: 00010000:00010000:3.0:1790710714.084437:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c520216ba00/0xcbad34b281570b43 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbad34b281570b3c expref: 12 pid: 5840 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710714.084444:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f8ce4700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5838:1877696176994048:0@lo:104: 00010000:00010000:3.0:1790710714.084465:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c51c13fd000/0xcbad34b281570bf2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710714.084473:0:5838:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c51c13fd000/0xcbad34b281570bf2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710714.084480:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c51c13fd000/0xcbad34b281570bf2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710714.084486:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c51c13fd000/0xcbad34b281570bf2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1790710714.084499:0:5838:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1790710714.085700:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9575c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d27fc27-b651-404a-bd8c-b798806fb18a:3310:1877696176994688:0@lo:103: 00000100:00100000:0.0:1790710714.129881:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c64e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+11:7626:x1877696176993408:12345-0@lo:253: Request processed in 76162us (76477us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710714.129895:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1790710714.130107:0:7626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9574000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:7626:1877696176993408:0@lo:253: 10000000:01000000:2.0:1790710714.130123:0:7626:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1790710714.130159:0:7626:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790710714.130161:0:7626:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790710714.130163:0:7626:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790710714.130164:0:7626:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1790710714.130165:0:7626:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790710714.130167:0:7626:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790710714.130168:0:7626:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790710714.130170:0:7626:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1790710714.130172:0:7626:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790710714.130173:0:7626:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1790710714.130193:0:7626:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c51ff4b3000 from lustre-OST0001 10000000:01000000:2.0:1790710714.130218:0:7626:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1790710714.130221:0:7626:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1790710714.130229:0:7626:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9c51d02d19c0 local copy 10000000:01000000:2.0:1790710714.130233:0:7626:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1790710714.130267:0:7626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c8047200/0xcbad34b281570bf9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710714.130278:0:7626:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.146@tcp lock: ffff9c51c8047200/0xcbad34b281570bf9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710714.130287:0:7626:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.146@tcp lock: ffff9c51c8047200/0xcbad34b281570bf9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710714.130323:0:7626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c8e8dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:7626:1877696176994816:0@lo:101: 00000100:00100000:2.0:1790710714.130356:0:7626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710714.130384:0:7626:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f45209c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790710714.130494:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176994816 00000100:00100000:0.0:1790710714.130501:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176994816 00000100:00100000:0.0:1790710714.130542:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1790710714.130551:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c64e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+11:7626:x1877696176994816:12345-0@lo:101: 00010000:00010000:0.0:1790710714.130565:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790710714.130578:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c51c0030000/0xcbad34b281570c00 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbad34b281570bf9 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710714.130600:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c51c0030000/0xcbad34b281570c00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbad34b281570bf9 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710714.130609:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c51c0030000/0xcbad34b281570c00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281570bf9 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710714.130617:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c0030000, rc 0) 00000100:00100000:0.0:1790710714.130645:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c64e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+12:7626:x1877696176994816:12345-0@lo:101: Request processed in 95us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710714.130651:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1790710714.130989:0:7626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c8e8dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:7626:1877696176994816:0@lo:101: 00010000:00010000:2.0:1790710714.131003:0:7626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.146@tcp lock: ffff9c51c8047200/0xcbad34b281570bf9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xcbad34b281570c00 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710714.131012:0:7626:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.146@tcp lock: ffff9c51c8047200/0xcbad34b281570bf9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xcbad34b281570c00 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710714.131261:0:7626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c8e8dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:7626:1877696176994944:0@lo:501: 00000100:00100000:2.0:1790710714.131293:0:7626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710714.131313:0:7626:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f45209c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790710714.131370:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176994944 00000100:00100000:0.0:1790710714.131381:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176994944 00000100:00100000:0.0:1790710714.131411:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1790710714.131417:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c64e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+12:7626:x1877696176994944:12345-0@lo:501: 00000100:00100000:0.0:1790710714.131602:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c64e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+12:7626:x1877696176994944:12345-0@lo:501: Request processed in 184us (307us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790710714.131609:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1790710714.131719:0:7626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c8e8dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:7626:1877696176994944:0@lo:501: 10000000:01000000:2.0:1790710714.131732:0:7626:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.146@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1790710714.131757:0:7626:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.146@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1790710714.131763:0:7626:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c8047200/0xcbad34b281570bf9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xcbad34b281570c00 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710714.131772:0:7626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c8047200/0xcbad34b281570bf9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xcbad34b281570c00 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710714.131779:0:7626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.146@tcp lock: ffff9c51c8047200/0xcbad34b281570bf9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xcbad34b281570c00 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710714.131927:0:7626:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1790710714.131963:0:7626:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c51ff4b3000 10000000:01000000:2.0:1790710714.131968:0:7626:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1790710714.131973:0:7626:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1790710714.131976:0:7626:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790710714.131980:0:7626:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1790710714.131983:0:7626:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1790710714.132002:0:7626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c8046e00/0xcbad34b281570c07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710714.132010:0:7626:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.146@tcp lock: ffff9c51c8046e00/0xcbad34b281570c07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710714.132018:0:7626:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.146@tcp lock: ffff9c51c8046e00/0xcbad34b281570c07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710714.132030:0:7626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c8e8dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:7626:1877696176995072:0@lo:101: 00000100:00100000:2.0:1790710714.132060:0:7626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710714.132092:0:7626:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f4520e40 going to sleep for 11 seconds 00000100:00100000:3.0:1790710714.132264:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176995072 00000100:00100000:3.0:1790710714.132269:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176995072 00000100:00100000:3.0:1790710714.132317:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1790710714.132324:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c80fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+12:7626:x1877696176995072:12345-0@lo:101: 00010000:00010000:3.0:1790710714.132342:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790710714.132353:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c51c13fd000/0xcbad34b281570c0e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbad34b281570c07 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710714.132370:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c51c13fd000/0xcbad34b281570c0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbad34b281570c07 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710714.132380:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c51c13fd000/0xcbad34b281570c0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281570c07 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710714.132387:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c13fd000, rc 0) 00000100:00100000:3.0:1790710714.132417:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c80fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+13:7626:x1877696176995072:12345-0@lo:101: Request processed in 93us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710714.132422:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00010000:0.0:1790710714.132647:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790710714.132654:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.146@tcp lock: ffff9c51c8047200/0xcbad34b281570bf9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xcbad34b281570c00 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710714.132661:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c8047200 already unused, calling callback (ffffffffc1cdfc20) 10000000:00010000:0.0:1790710714.132665:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.146@tcp lock: ffff9c51c8047200/0xcbad34b281570bf9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xcbad34b281570c00 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710714.132673:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.146@tcp lock: ffff9c51c8047200/0xcbad34b281570bf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xcbad34b281570c00 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790710714.132680:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.146@tcp lock: ffff9c51c8047200/0xcbad34b281570bf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xcbad34b281570c00 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790710714.132686:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790710714.132704:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.146@tcp lock: ffff9c51c8047200/0xcbad34b281570bf9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xcbad34b281570c00 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710714.132709:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790710714.132734:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.146@tcp lock: ffff9c51c8047200/0xcbad34b281570bf9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xcbad34b281570c00 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710714.132741:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.146@tcp lock: ffff9c51c8047200/0xcbad34b281570bf9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xcbad34b281570c00 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710714.132763:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790710714.132765:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790710714.132767:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790710714.132775:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790710714.132913:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9576d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d27fc27-b651-404a-bd8c-b798806fb18a:3309:1877696176995200:0@lo:103: 00000100:00100000:0.0:1790710714.132956:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710714.132994:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176995200 00000100:00100000:0.0:1790710714.132998:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176995200 00000100:00100000:0.0:1790710714.133025:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790710714.133031:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9574000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d27fc27-b651-404a-bd8c-b798806fb18a+13:3309:x1877696176995200:12345-0@lo:103: 00010000:00010000:0.0:1790710714.133039:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790710714.133050:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c51c0030000/0xcbad34b281570c00 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcbad34b281570bf9 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710714.133059:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790710714.133099:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9574000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d27fc27-b651-404a-bd8c-b798806fb18a+12:3309:x1877696176995200:12345-0@lo:103: Request processed in 68us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710714.133105:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790710714.133343:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9576d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d27fc27-b651-404a-bd8c-b798806fb18a:3309:1877696176995200:0@lo:103: 00000100:00100000:2.0:1790710714.133563:0:7626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c8e8dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:7626:1877696176995072:0@lo:101: 00010000:00010000:2.0:1790710714.133579:0:7626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.146@tcp lock: ffff9c51c8046e00/0xcbad34b281570c07 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570c0e expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710714.133588:0:7626:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.146@tcp lock: ffff9c51c8046e00/0xcbad34b281570c07 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbad34b281570c0e expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710714.133674:0:7626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c8e8dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:7626:1877696176995328:0@lo:501: 00000100:00100000:2.0:1790710714.133702:0:7626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710714.133771:0:7626:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f4520e40 going to sleep for 11 seconds 00000100:00100000:3.0:1790710714.133926:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176995328 00000100:00100000:3.0:1790710714.133931:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176995328 00000100:00100000:3.0:1790710714.133976:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1790710714.133983:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c80fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+12:7626:x1877696176995328:12345-0@lo:501: 00000100:00100000:3.0:1790710714.134373:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c80fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+12:7626:x1877696176995328:12345-0@lo:501: Request processed in 389us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710714.134380:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1790710714.134590:0:7626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c8e8dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:7626:1877696176995328:0@lo:501: 00000100:00100000:3.0:1790710714.134699:0:7626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f8ce4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:7626:1877696176995456:0@lo:503: 00000100:00100000:3.0:1790710714.134741:0:7626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710714.134924:0:7626:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f9b2d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790710714.134976:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176995456 00000100:00100000:0.0:1790710714.134981:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176995456 00000100:00100000:0.0:1790710714.135052:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1790710714.135060:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c80fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+12:7626:x1877696176995456:12345-0@lo:503: 00000100:00100000:0.0:1790710714.135397:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c80fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+12:7626:x1877696176995456:12345-0@lo:503: Request processed in 337us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710714.135405:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1790710714.135516:0:7626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f8ce4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:7626:1877696176995456:0@lo:503: 00000040:00080000:2.0:1790710714.135829:0:7626:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790710714.135899:0:7626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c8e8df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:7626:1877696176995584:0@lo:502: 00000100:00100000:2.0:1790710714.135952:0:7626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710714.136425:0:7626:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f4520900 going to sleep for 11 seconds 00000100:00100000:3.0:1790710714.136509:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176995584 00000100:00100000:3.0:1790710714.136514:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176995584 00000100:00100000:3.0:1790710714.136542:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1790710714.136549:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c80fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+12:7626:x1877696176995584:12345-0@lo:502: 00000100:00100000:3.0:1790710714.136719:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c80fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+12:7626:x1877696176995584:12345-0@lo:502: Request processed in 169us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710714.136726:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1790710714.136825:0:7626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c8e8df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:7626:1877696176995584:0@lo:502: 00000040:00080000:2.0:1790710714.137090:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1790710714.137384:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1790710714.137426:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1790710714.137480:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1790710714.137520:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1790710714.137558:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1790710714.137590:0:7626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c8e8df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:7626:1877696176995712:0@lo:502: 00000100:00100000:2.0:1790710714.137632:0:7626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710714.137651:0:7626:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f4520900 going to sleep for 11 seconds 00000100:00100000:3.0:1790710714.137724:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176995712 00000100:00100000:3.0:1790710714.137730:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176995712 00000100:00100000:3.0:1790710714.137754:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1790710714.137761:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c80f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+12:7626:x1877696176995712:12345-0@lo:502: 00000100:00100000:3.0:1790710714.137911:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c80f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+12:7626:x1877696176995712:12345-0@lo:502: Request processed in 149us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710714.137918:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1790710714.138103:0:7626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c8e8df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:7626:1877696176995712:0@lo:502: 00000040:00080000:2.0:1790710714.138210:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1790710714.138220:0:7626:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1790710714.138664:0:7633:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1790710714.138671:0:7633:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1790710714.138677:0:7633:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790710714.138680:0:7633:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1790710714.138685:0:7633:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790710714.138706:0:7633:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9c51f97ccd40) 00000020:00000080:3.0:1790710714.138725:0:7633:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:3.0:1790710714.138731:0:7633:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1790710714.138956:0:7633:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c51ff4b3000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1790710714.138964:0:7633:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1790710714.138969:0:7633:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xcbad34b281570c1c 00010000:00010000:3.0:1790710714.143976:0:7633:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:3.0:1790710714.144677:0:7633:0:(tgt_lastrcvd.c:1879:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1790710714.148095:0:7633:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1790710714.148426:0:7633:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1790710714.153544:0:7633:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1790710714.154256:0:7633:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1790710714.158037:0:7633:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1790710714.158049:0:7633:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790710714.158061:0:7633:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790710714.158063:0:7633:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1790710714.158067:0:7633:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790710714.158071:0:7633:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790710714.158072:0:7633:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1790710714.158075:0:7633:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1790710714.158077:0:7633:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1790710714.158159:0:7633:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790710714.158163:0:7633:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790710714.158164:0:7633:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:3.0:1790710714.158168:0:7633:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1790710714.158524:0:7626:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1790710714.158550:0:7626:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.146@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1790710714.158573:0:7626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c8046e00/0xcbad34b281570c07 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570c0e expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710714.158586:0:7626:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.146@tcp lock: ffff9c51c8046e00/0xcbad34b281570c07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570c0e expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790710714.158594:0:7626:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c51ff4b3000 from 1 10000000:01000000:1.0:1790710714.158596:0:7626:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790710714.158629:0:7626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c1645c00/0xcbad34b281570c23 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710714.158637:0:7626:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.146@tcp lock: ffff9c51c1645c00/0xcbad34b281570c23 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710714.158647:0:7626:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.146@tcp lock: ffff9c51c1645c00/0xcbad34b281570c23 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710714.158679:0:7626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c812ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:7626:1877696176995840:0@lo:101: 00000100:00100000:1.0:1790710714.158738:0:7626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710714.158768:0:7626:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c679ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790710714.158990:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176995840 00000100:00100000:3.0:1790710714.158998:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176995840 00000100:00100000:3.0:1790710714.159044:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1790710714.159053:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c80f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+12:7626:x1877696176995840:12345-0@lo:101: 00010000:00010000:3.0:1790710714.159065:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790710714.159257:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c51c13fc400/0xcbad34b281570c2a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbad34b281570c23 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710714.159283:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c51c13fc400/0xcbad34b281570c2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbad34b281570c23 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710714.159294:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c51c13fc400/0xcbad34b281570c2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281570c23 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710714.159302:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c13fc400, rc 0) 00000100:00100000:3.0:1790710714.159512:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c80f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+13:7626:x1877696176995840:12345-0@lo:101: Request processed in 460us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710714.159520:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1790710714.161516:0:7626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c812ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:7626:1877696176995840:0@lo:101: 00010000:00010000:1.0:1790710714.161541:0:7626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.146@tcp lock: ffff9c51c1645c00/0xcbad34b281570c23 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570c2a expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710714.161552:0:7626:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.146@tcp lock: ffff9c51c1645c00/0xcbad34b281570c23 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbad34b281570c2a expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710714.161658:0:7626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c812ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:7626:1877696176995968:0@lo:501: 00000100:00100000:1.0:1790710714.161708:0:7626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710714.162044:0:7626:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c679ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790710714.163367:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176995968 00000100:00100000:0.0:1790710714.163377:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176995968 00000100:00100000:0.0:1790710714.163430:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1790710714.163440:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c80fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+13:7626:x1877696176995968:12345-0@lo:501: 00000100:00100000:0.0:1790710714.163691:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c80fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+13:7626:x1877696176995968:12345-0@lo:501: Request processed in 253us (1982us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710714.163700:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1790710714.164514:0:7626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c812ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:7626:1877696176995968:0@lo:501: 00000100:00100000:0.0:1790710714.164555:0:7626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9576d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:7626:1877696176996096:0@lo:503: 00000100:00100000:0.0:1790710714.164601:0:7626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710714.164637:0:7626:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c70cfe40 going to sleep for 11 seconds 00000100:00100000:2.0:1790710714.164726:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176996096 00000100:00100000:2.0:1790710714.164732:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176996096 00000100:00100000:2.0:1790710714.164774:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1790710714.164783:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c80f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+13:7626:x1877696176996096:12345-0@lo:503: 00000100:00100000:2.0:1790710714.165477:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c80f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+13:7626:x1877696176996096:12345-0@lo:503: Request processed in 694us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710714.165486:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1790710714.167633:0:7626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9576d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:7626:1877696176996096:0@lo:503: 00000040:00080000:1.0:1790710714.168318:0:7626:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790710714.168396:0:7626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c812c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:7626:1877696176996224:0@lo:502: 00000100:00100000:1.0:1790710714.168468:0:7626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710714.168542:0:7626:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c679c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790710714.169393:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176996224 00000100:00100000:3.0:1790710714.169401:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176996224 00000100:00100000:3.0:1790710714.169488:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1790710714.169497:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c80f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+13:7626:x1877696176996224:12345-0@lo:502: 00000100:00100000:3.0:1790710714.169745:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c80f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+13:7626:x1877696176996224:12345-0@lo:502: Request processed in 249us (1276us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710714.169752:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1790710714.169841:0:7626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c812c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:7626:1877696176996224:0@lo:502: 00000040:00080000:1.0:1790710714.170115:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1790710714.170455:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1790710714.170489:0:7626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c812c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:7626:1877696176996352:0@lo:502: 00000100:00100000:1.0:1790710714.170536:0:7626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710714.170809:0:7626:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c679c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790710714.170972:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176996352 00000100:00100000:0.0:1790710714.170980:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176996352 00000100:00100000:0.0:1790710714.171018:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1790710714.171025:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c80fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+13:7626:x1877696176996352:12345-0@lo:502: 00000100:00100000:0.0:1790710714.171474:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c80fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+13:7626:x1877696176996352:12345-0@lo:502: Request processed in 447us (935us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710714.171482:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1790710714.171562:0:7626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c812c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:7626:1877696176996352:0@lo:502: 00000040:00080000:1.0:1790710714.171701:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1790710714.171714:0:7626:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1790710714.172596:0:7637:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790710714.172607:0:7637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790710714.172610:0:7637:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1790710714.172615:0:7637:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c51ff4b3000 00000020:00000080:1.0:1790710714.172617:0:7637:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790710714.172636:0:7637:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790710714.172639:0:7637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790710714.172641:0:7637:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1790710714.172643:0:7637:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1790710714.172755:0:7626:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1790710714.172773:0:7626:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790710714.172805:0:7626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c1645c00/0xcbad34b281570c23 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570c2a expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710714.172817:0:7626:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.146@tcp lock: ffff9c51c1645c00/0xcbad34b281570c23 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570c2a expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790710714.172863:0:7626:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1790710714.172866:0:7626:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c51ff4b3000 10000000:01000000:0.0:1790710714.172881:0:7626:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c51ff4b3000 10000000:01000000:0.0:1790710714.172885:0:7626:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790710714.172890:0:7626:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c51ff4b3000 from 1 10000000:01000000:0.0:1790710714.172892:0:7626:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790710714.172925:0:7626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c0030000/0xcbad34b281570c31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710714.172933:0:7626:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.146@tcp lock: ffff9c51c0030000/0xcbad34b281570c31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710714.172953:0:7626:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.146@tcp lock: ffff9c51c0030000/0xcbad34b281570c31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710714.172972:0:7626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9575c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:7626:1877696176996480:0@lo:101: 00000100:00100000:0.0:1790710714.173021:0:7626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710714.173062:0:7626:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c300d900 going to sleep for 11 seconds 00000100:00100000:1.0:1790710714.173334:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176996480 00000100:00100000:1.0:1790710714.173340:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176996480 00000100:00100000:1.0:1790710714.173374:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1790710714.173383:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c80f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+13:7626:x1877696176996480:12345-0@lo:101: 00010000:00010000:1.0:1790710714.173395:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790710714.173407:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c51c1644e00/0xcbad34b281570c38 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbad34b281570c31 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710714.173429:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c51c1644e00/0xcbad34b281570c38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbad34b281570c31 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710714.173438:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c51c1644e00/0xcbad34b281570c38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281570c31 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710714.173447:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c1644e00, rc 0) 00000100:00100000:1.0:1790710714.173483:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c80f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+14:7626:x1877696176996480:12345-0@lo:101: Request processed in 101us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710714.173490:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1790710714.173569:0:7626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9575c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:7626:1877696176996480:0@lo:101: 00010000:00010000:0.0:1790710714.173583:0:7626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.146@tcp lock: ffff9c51c0030000/0xcbad34b281570c31 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570c38 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710714.173591:0:7626:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.146@tcp lock: ffff9c51c0030000/0xcbad34b281570c31 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbad34b281570c38 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710714.173667:0:7626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9575c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:7626:1877696176996608:0@lo:501: 00000100:00100000:0.0:1790710714.173693:0:7626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710714.173709:0:7626:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c300d900 going to sleep for 11 seconds 00000100:00100000:0.0:1790710714.173724:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176996608 00000100:00100000:0.0:1790710714.173727:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176996608 00000100:00100000:0.0:1790710714.173759:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1790710714.173766:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c80f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+14:7626:x1877696176996608:12345-0@lo:501: 00000100:00100000:0.0:1790710714.173991:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c80f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+14:7626:x1877696176996608:12345-0@lo:501: Request processed in 225us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710714.173998:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1790710714.174022:0:7626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9575c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:7626:1877696176996608:0@lo:501: 00000100:00100000:0.0:1790710714.174045:0:7626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9575c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:7626:1877696176996736:0@lo:503: 00000100:00100000:0.0:1790710714.174371:0:7626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710714.174421:0:7626:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c300d900 going to sleep for 11 seconds 00000100:00100000:0.0:1790710714.174442:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176996736 00000100:00100000:0.0:1790710714.174447:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176996736 00000100:00100000:1.0:1790710714.174903:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1790710714.174921:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c80fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+14:7626:x1877696176996736:12345-0@lo:503: 00000100:00100000:1.0:1790710714.175434:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c80fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+14:7626:x1877696176996736:12345-0@lo:503: Request processed in 514us (1063us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710714.175443:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1790710714.175536:0:7626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9575c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:7626:1877696176996736:0@lo:503: 00000040:00080000:0.0:1790710714.176004:0:7626:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790710714.176071:0:7626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9575c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:7626:1877696176996864:0@lo:502: 00000100:00100000:0.0:1790710714.176344:0:7626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710714.176414:0:7626:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c300d900 going to sleep for 11 seconds 00000100:00100000:1.0:1790710714.176455:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176996864 00000100:00100000:1.0:1790710714.176462:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176996864 00000100:00100000:1.0:1790710714.176528:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1790710714.176536:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c80fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+14:7626:x1877696176996864:12345-0@lo:502: 00000100:00100000:1.0:1790710714.176763:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c80fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+14:7626:x1877696176996864:12345-0@lo:502: Request processed in 227us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710714.176770:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1790710714.176984:0:7626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9575c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:7626:1877696176996864:0@lo:502: 00000040:00080000:0.0:1790710714.177529:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1790710714.177584:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1790710714.177618:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1790710714.177665:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1790710714.177702:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1790710714.177751:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1790710714.177912:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1790710714.177967:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1790710714.178018:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1790710714.178056:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1790710714.178535:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1790710714.178590:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1790710714.178637:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1790710714.178668:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1790710714.178714:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1790710714.178748:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1790710714.178781:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1790710714.179004:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1790710714.179043:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1790710714.179077:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1790710714.179419:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1790710714.179454:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1790710714.179489:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1790710714.179533:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1790710714.179564:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1790710714.179590:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1790710714.179657:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1790710714.179694:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:0.0:1790710714.179730:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1790710714.179772:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:0.0:1790710714.179928:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:0.0:1790710714.179974:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:0.0:1790710714.180005:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:0.0:1790710714.180063:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:0.0:1790710714.180385:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:0.0:1790710714.180439:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:0.0:1790710714.180474:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:0.0:1790710714.180521:0:7626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9575c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:7626:1877696176996992:0@lo:502: 00000100:00100000:0.0:1790710714.180595:0:7626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710714.180825:0:7626:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c300d900 going to sleep for 11 seconds 00000100:00100000:1.0:1790710714.181064:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176996992 00000100:00100000:1.0:1790710714.181073:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176996992 00000100:00100000:1.0:1790710714.181434:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1790710714.181444:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c80f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+14:7626:x1877696176996992:12345-0@lo:502: 00000100:00100000:1.0:1790710714.181672:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c80f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+14:7626:x1877696176996992:12345-0@lo:502: Request processed in 229us (1076us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710714.181680:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1790710714.181770:0:7626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9575c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:7626:1877696176996992:0@lo:502: 00000040:00080000:0.0:1790710714.181874:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:0.0:1790710714.181886:0:7626:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1790710714.182620:0:7638:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1790710714.182634:0:7638:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9c51fa0e4d40) 00000020:00000080:0.0:1790710714.182663:0:7638:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:0.0:1790710714.182731:0:7638:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c51ff4b3000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1790710714.182735:0:7638:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c51ff4b3000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1790710714.182738:0:7638:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c51ff4b3000 3 00010000:00080000:0.0:1790710714.182765:0:7638:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c51c64a0800@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.146@tcp at head 00010000:00010000:0.0:1790710714.186528:0:7638:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:0.0:1790710714.187078:0:7638:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1790710714.187114:0:7638:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1790710714.187210:0:7638:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xcbad34b281570c46 00000100:00080000:0.0:1790710714.187221:0:7638:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790710714.187232:0:7638:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c51c64a0800 using connection 192.168.206.146@tcp/0@lo 00000100:00100000:0.0:1790710714.187266:0:7638:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c51f9575c00 x1877696176997120/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790710714.187292:0:7638:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1790710714.187365:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9576300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1877696176997248:0@lo:400: 00000100:00100000:0.0:1790710714.187424:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710714.187455:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790710714.187462:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9577800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1877696176997376:0@lo:400: 00000100:00100000:0.0:1790710714.187484:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710714.187512:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9575880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1877696176997504:0@lo:400: 00000100:00100000:0.0:1790710714.187536:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710714.187565:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176997248 00000100:00100000:0.0:1790710714.187571:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176997248 00000100:00100000:0.0:1790710714.187602:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176997376 00000100:00100000:0.0:1790710714.187604:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176997376 00000100:00100000:0.0:1790710714.187620:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790710714.187644:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9575180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1877696176997248:12345-0@lo:400: 00000100:00100000:2.0:1790710714.188715:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9575c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3308:1877696176997120:0@lo:38: 00000100:00100000:2.0:1790710714.188764:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710714.188972:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9575180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1877696176997248:12345-0@lo:400: Request processed in 1327us (1545us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710714.188981:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790710714.189000:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176997120 00000100:00100000:0.0:1790710714.189006:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176997120 00000100:00100000:0.0:1790710714.189022:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790710714.189030:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9574380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1877696176997376:12345-0@lo:400: 00000100:00100000:0.0:1790710714.189067:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9574380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1877696176997376:12345-0@lo:400: Request processed in 39us (1582us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710714.189073:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790710714.189095:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790710714.189099:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8e8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3308:x1877696176997120:12345-0@lo:38: 00010000:00080000:0.0:1790710714.189119:0:5846:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 191 last 0 00010000:00080000:2.0:1790710714.189290:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c51f9577800 x1877696176997376/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790710730 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790710714.189316:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9577800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1877696176997376:0@lo:400: 00010000:00080000:2.0:1790710714.189331:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c51f9576300 x1877696176997248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790710730 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790710714.189339:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9576300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1877696176997248:0@lo:400: 00000020:00000080:0.0:1790710714.189478:0:5846:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xcbad34b281570c4d 00000004:00100000:0.0:1790710714.189493:0:5846:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1790710714.189522:0:5846:0:(import.c:65:import_set_state_nolock()) ffff9c51c64a3800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790710714.189567:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8e8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1877696176997120:12345-0@lo:38: Request processed in 466us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710714.189574:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790710714.189603:0:6696:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176997504 00000100:00100000:0.0:1790710714.189607:0:6696:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176997504 00000100:00100000:0.0:1790710714.189677:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790710714.189684:0:6696:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9576d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1877696176997504:12345-0@lo:400: 00000100:00100000:0.0:1790710714.189723:0:6696:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9576d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1877696176997504:12345-0@lo:400: Request processed in 39us (2185us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710714.189729:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1790710714.189811:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c51f9575c00 x1877696176997120/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790710724 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790710714.189819:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790710714.189825:0:3308:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1790710714.189832:0:3308:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1790710714.189836:0:3308:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1790710714.189838:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9c51c64a0800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1790710714.189843:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9575c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3308:1877696176997120:0@lo:38: 00010000:00080000:0.0:1790710714.190562:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c51f9575880 x1877696176997504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790710730 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790710714.190574:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9575880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1877696176997504:0@lo:400: 00000040:00080000:2.0:1790710714.190996:0:7638:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:3.0:1790710714.191261:0:7626:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1790710714.191284:0:7626:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790710714.191301:0:7626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c0030000/0xcbad34b281570c31 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570c38 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710714.191311:0:7626:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.146@tcp lock: ffff9c51c0030000/0xcbad34b281570c31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570c38 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1790710714.191350:0:7626:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1790710714.191352:0:7626:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790710714.191354:0:7626:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790710714.191354:0:7626:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790710714.191356:0:7626:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790710714.191357:0:7626:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790710714.191358:0:7626:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790710714.191359:0:7626:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790710714.191361:0:7626:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790710714.191362:0:7626:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790710714.191363:0:7626:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790710714.191366:0:7626:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1790710714.191368:0:7626:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790710714.191370:0:7626:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790710714.191371:0:7626:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790710714.191372:0:7626:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790710714.191373:0:7626:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790710714.191374:0:7626:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790710714.191375:0:7626:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790710714.191376:0:7626:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790710714.191377:0:7626:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790710714.191378:0:7626:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790710714.191382:0:7626:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790710714.191403:0:7626:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1790710714.191417:0:7626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f8ce4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:7626:1877696176997632:0@lo:253: 00000100:00100000:3.0:1790710714.191480:0:7626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710714.191511:0:7626:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f9b2d540 going to sleep for 11 seconds 00000100:00100000:2.0:1790710714.191596:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176997632 00000100:00100000:2.0:1790710714.191603:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176997632 00000100:00100000:2.0:1790710714.191631:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1790710714.191638:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c80f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+14:7626:x1877696176997632:12345-0@lo:253: 20000000:01000000:2.0:1790710714.191660:0:5840:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1790710714.191672:0:5840:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1790710714.192587:0:7639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9575880 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7639:1877696176997760:0@lo:901: 00000100:00100000:0.0:1790710714.192635:0:7639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710714.192665:0:7639:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c300dc00 going to sleep for 11 seconds 00000100:00100000:2.0:1790710714.192722:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176997760 00000100:00100000:2.0:1790710714.192728:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176997760 00000100:00100000:2.0:1790710714.192782:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790710714.192915:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9575c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7639:x1877696176997760:12345-0@lo:901: 00000100:00100000:2.0:1790710714.193424:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9575c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7639:x1877696176997760:12345-0@lo:901: Request processed in 633us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710714.193440:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1790710714.193521:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1790710714.193550:0:7639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c51f9575880 x1877696176997760/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1790710730 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790710714.193563:0:7639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9575880 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7639:1877696176997760:0@lo:901: 20000000:01000000:0.0:1790710714.226445:0:5840:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1790710714.226464:0:5840:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1790710714.226628:0:5861:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1790710714.226633:0:5861:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1790710714.226653:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c51c1645a00/0xcbad34b281570c54 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710714.226672:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c520216b400/0xcbad34b281570ba5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281570b9e expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710714.226682:0:5861:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c51c1645a00/0xcbad34b281570c54 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710714.226735:0:5861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c520216b400/0xcbad34b281570ba5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbad34b281570b9e expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710714.226750:0:5861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c520216b400/0xcbad34b281570ba5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbad34b281570b9e expref: 14 pid: 5838 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710714.226764:0:5861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c812c380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5861:1877696176997888:0@lo:104: 00000100:00100000:1.0:1790710714.226839:0:5861:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710714.226884:0:5861:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c300db40 going to sleep for 11 seconds 00000100:00100000:0.0:1790710714.226967:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176997888 00000100:00100000:0.0:1790710714.226974:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176997888 00000100:00100000:0.0:1790710714.227025:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790710714.227034:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c812d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5d27fc27-b651-404a-bd8c-b798806fb18a+3:5861:x1877696176997888:12345-0@lo:104: 00010000:00010000:0.0:1790710714.227045:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.146@tcp lock: ffff9c520216a800/0xcbad34b281570b9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbad34b281570ba5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710714.227109:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790710714.227115:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c812d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5d27fc27-b651-404a-bd8c-b798806fb18a+3:5861:x1877696176997888:12345-0@lo:104: Request processed in 83us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710714.227121:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1790710714.227175:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790710714.227181:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.146@tcp lock: ffff9c520216a800/0xcbad34b281570b9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbad34b281570ba5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710714.227188:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c520216a800 already unused, calling callback (ffffffffc1cdfc20) 10000000:00010000:0.0:1790710714.227199:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.146@tcp lock: ffff9c520216a800/0xcbad34b281570b9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbad34b281570ba5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710714.227208:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.146@tcp lock: ffff9c520216a800/0xcbad34b281570b9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbad34b281570ba5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790710714.227213:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.146@tcp lock: ffff9c520216a800/0xcbad34b281570b9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbad34b281570ba5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790710714.227218:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1790710714.227243:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.146@tcp lock: ffff9c520216a800/0xcbad34b281570b9e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281570ba5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710714.227249:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790710714.227264:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.146@tcp lock: ffff9c520216a800/0xcbad34b281570b9e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281570ba5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710714.227270:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.146@tcp lock: ffff9c520216a800/0xcbad34b281570b9e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281570ba5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710714.227285:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790710714.227287:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790710714.227289:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790710714.227300:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9575880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d27fc27-b651-404a-bd8c-b798806fb18a:3310:1877696176998016:0@lo:103: 00000100:00100000:0.0:1790710714.227329:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710714.227356:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176998016 00000100:00100000:0.0:1790710714.227360:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176998016 00010000:00010000:0.0:1790710714.227374:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c520216b400/0xcbad34b281570ba5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbad34b281570b9e expref: 15 pid: 5838 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710714.227393:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790710714.227406:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c7cdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d27fc27-b651-404a-bd8c-b798806fb18a+15:3310:x1877696176998016:12345-0@lo:103: 00010000:00010000:0.0:1790710714.227417:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790710714.227421:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c520216b400/0xcbad34b281570ba5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbad34b281570b9e expref: 15 pid: 5838 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710714.227432:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c520216b400/0xcbad34b281570ba5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbad34b281570b9e expref: 15 pid: 5838 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710714.227447:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c51c1645a00/0xcbad34b281570c54 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710714.227454:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c51c1645a00/0xcbad34b281570c54 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1790710714.227466:0:5831:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002018839s 00010000:00010000:0.0:1790710714.227470:0:5831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c51c1645a00/0xcbad34b281570c54 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710714.227477:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c51c1645a00/0xcbad34b281570c54 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710714.227485:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c51c1645a00/0xcbad34b281570c54 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710714.227491:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c51c1645a00/0xcbad34b281570c54 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710714.227497:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c1645a00 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:0.0:1790710714.227500:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c51c1645a00/0xcbad34b281570c54 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710714.227508:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c51c1645a00/0xcbad34b281570c54 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710714.227522:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c51c1645a00/0xcbad34b281570c54 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710714.227531:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790710714.227561:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c7cdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d27fc27-b651-404a-bd8c-b798806fb18a+15:3310:x1877696176998016:12345-0@lo:103: Request processed in 155us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710714.227567:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790710714.227621:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9575880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d27fc27-b651-404a-bd8c-b798806fb18a:3310:1877696176998016:0@lo:103: 00010000:00010000:1.0:1790710714.228361:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c520216b400/0xcbad34b281570ba5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbad34b281570b9e expref: 14 pid: 5838 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710714.228376:0:5861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c812c380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5861:1877696176997888:0@lo:104: 00010000:00010000:1.0:1790710714.228390:0:5861:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c51c1645a00/0xcbad34b281570c54 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710714.228398:0:5861:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c51c1645a00/0xcbad34b281570c54 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710714.228404:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c51c1645a00/0xcbad34b281570c54 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710714.228410:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c51c1645a00/0xcbad34b281570c54 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710714.234674:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c80f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+13:7626:x1877696176997632:12345-0@lo:253: Request processed in 43026us (43184us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710714.234687:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1790710714.234891:0:7626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f8ce4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d27fc27-b651-404a-bd8c-b798806fb18a:7626:1877696176997632:0@lo:253: 10000000:01000000:2.0:1790710714.234910:0:7626:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1790710714.234913:0:7626:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790710714.234915:0:7626:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790710714.234916:0:7626:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790710714.234917:0:7626:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790710714.234918:0:7626:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790710714.234919:0:7626:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790710714.234920:0:7626:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790710714.234922:0:7626:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790710714.234923:0:7626:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790710714.234925:0:7626:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790710714.234926:0:7626:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1790710714.234950:0:7626:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1790710714.243999:0:7626:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1790710714.244317:0:7626:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1790710714.244519:0:7626:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1790710714.244702:0:7626:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1790710714.245356:0:7626:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1790710714.245623:0:7626:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1790710714.247406:0:7626:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1790710714.480783:0:7626:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1790710714.480800:0:7626:0:(lfsck_lib.c:3084:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1790710714.480834:0:7626:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1790710714.480892:0:7626:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.146@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1790710714.480909:0:7626:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1790710714.480936:0:7626:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1790710714.887924:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790710715.917651:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790710716.939484:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790710717.961318:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790710718.218717:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790710718.218739:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c812c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1877696176998144:0@lo:13: 00000100:00100000:0.0:1790710718.218800:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710718.219032:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176998144 00000100:00100000:1.0:1790710718.219040:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176998144 00000100:00100000:1.0:1790710718.219158:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790710718.219168:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9575880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877696176998144:12345-0@lo:13: 00002000:00000024:1.0:1790710718.219203:0:6699:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790710718.219252:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9575880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877696176998144:12345-0@lo:13: Request processed in 85us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710718.219258:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1790710718.220102:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790710718.220306:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51c812c380 x1877696176998144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790710734 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790710718.220327:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c812c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1877696176998144:0@lo:13: 00010000:00010000:1.0:1790710718.989445:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790710719.244738:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c8e8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877696176998400:0@lo:400: 00000100:00100000:1.0:1790710719.244801:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c8e8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d27fc27-b651-404a-bd8c-b798806fb18a:3312:1877696176998272:0@lo:400: 00000100:00100000:2.0:1790710719.244814:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710719.244836:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710719.244876:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790710719.244893:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c8e8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1877696176998528:0@lo:400: 00000100:00100000:2.0:1790710719.244930:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710719.244964:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176998400 00000100:00100000:2.0:1790710719.244970:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176998400 00000100:00100000:2.0:1790710719.245008:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176998528 00000100:00100000:2.0:1790710719.245011:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176998528 00000100:00100000:2.0:1790710719.245034:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790710719.245041:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8e8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877696176998400:12345-0@lo:400: 00000100:00100000:2.0:1790710719.245091:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8e8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877696176998400:12345-0@lo:400: Request processed in 49us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710719.245098:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790710719.245114:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790710719.245120:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8e8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877696176998528:12345-0@lo:400: 00000100:00100000:2.0:1790710719.245190:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8e8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877696176998528:12345-0@lo:400: Request processed in 69us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710719.245197:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1790710719.245220:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1790710719.245246:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51c8e8e300 x1877696176998528/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790710735 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790710719.245260:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c8e8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1877696176998528:0@lo:400: 00010000:00080000:2.0:1790710719.245271:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51c8e8f800 x1877696176998400/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790710735 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790710719.245280:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c8e8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877696176998400:0@lo:400: 00000100:00100000:3.0:1790710719.245486:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c8e8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696176998656:0@lo:400: 00000100:00100000:3.0:1790710719.245520:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710719.247906:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c8e8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1877696176998784:0@lo:400: 00000100:00100000:1.0:1790710719.247995:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710719.248055:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176998272 00000100:00100000:1.0:1790710719.248063:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176998272 00000100:00100000:1.0:1790710719.248111:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1790710719.248119:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ee788050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+13:3312:x1877696176998272:12345-0@lo:400: 00000100:00100000:2.0:1790710719.248199:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176998656 00000100:00100000:2.0:1790710719.248204:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176998656 00000100:00100000:2.0:1790710719.248236:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790710719.248244:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f8ce5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1877696176998656:12345-0@lo:400: 00000100:00100000:2.0:1790710719.248315:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f8ce5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1877696176998656:12345-0@lo:400: Request processed in 72us (2794us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710719.248322:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1790710719.248384:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51c8e8c000 x1877696176998656/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790710735 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790710719.248397:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c8e8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696176998656:0@lo:400: 00000100:00100000:2.0:1790710719.248422:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176998784 00000100:00100000:2.0:1790710719.248426:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176998784 00000100:00100000:2.0:1790710719.248456:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790710719.248462:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c812d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1877696176998784:12345-0@lo:400: 00000100:00100000:2.0:1790710719.248500:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c812d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1877696176998784:12345-0@lo:400: Request processed in 38us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710719.248507:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1790710719.248525:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1790710719.248544:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51c8e8e680 x1877696176998784/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790710735 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790710719.248554:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c8e8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1877696176998784:0@lo:400: 00000100:00100000:1.0:1790710719.251159:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ee788050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+13:3312:x1877696176998272:12345-0@lo:400: Request processed in 3033us (6314us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710719.251184:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1790710719.252178:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c8e8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d27fc27-b651-404a-bd8c-b798806fb18a:3312:1877696176998272:0@lo:400: 00010000:00010000:3.0:1790710720.009658:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790710721.035595:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1790710721.076875:0:7982:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg646-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1790710722.056420:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1790710722.312231:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1790710722.312238:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c51f444d000 from 30 10000000:01000000:3.0:1790710722.312243:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790710722.312288:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c13fd200/0xcbad34b281570c5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710722.312596:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.146@tcp lock: ffff9c51c13fd200/0xcbad34b281570c5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710722.312610:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.146@tcp lock: ffff9c51c13fd200/0xcbad34b281570c5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710722.312634:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f8ce6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696176998912:0@lo:101: 00000100:00100000:3.0:1790710722.312699:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710722.312760:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176998912 00000100:00100000:1.0:1790710722.312769:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176998912 00000100:00100000:1.0:1790710722.312832:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1790710722.312842:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ee78b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+13:5842:x1877696176998912:12345-0@lo:101: 00010000:00010000:1.0:1790710722.312855:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790710722.312868:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c51c1645200/0xcbad34b281570c62 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbad34b281570c5b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710722.312891:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c51c1645200/0xcbad34b281570c62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbad34b281570c5b expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710722.312924:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c51c1645200/0xcbad34b281570c62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281570c5b expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710722.312933:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c1645200, rc 0) 00000100:00100000:3.0:1790710722.312949:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c2bb6c00 going to sleep for 11 seconds 00000100:00100000:1.0:1790710722.312987:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ee78b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+14:5842:x1877696176998912:12345-0@lo:101: Request processed in 146us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710722.312993:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1790710722.313038:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f8ce6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696176998912:0@lo:101: 00010000:00010000:1.0:1790710722.313052:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.146@tcp lock: ffff9c51c13fd200/0xcbad34b281570c5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570c62 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710722.313060:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.146@tcp lock: ffff9c51c13fd200/0xcbad34b281570c5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbad34b281570c62 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710722.313111:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c812c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696176999040:0@lo:501: 00000100:00100000:1.0:1790710722.313181:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710722.313205:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c8daea80 going to sleep for 11 seconds 00000100:00100000:2.0:1790710722.313288:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176999040 00000100:00100000:2.0:1790710722.313292:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176999040 00000100:00100000:2.0:1790710722.313317:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1790710722.313323:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ee78ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+14:5842:x1877696176999040:12345-0@lo:501: 00000100:00100000:2.0:1790710722.313662:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ee78ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+14:5842:x1877696176999040:12345-0@lo:501: Request processed in 337us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710722.313669:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1790710722.313708:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c812c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696176999040:0@lo:501: 00000100:00100000:3.0:1790710722.313739:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f8ce5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696176999168:0@lo:503: 00000100:00100000:3.0:1790710722.313920:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710722.313943:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c2bb6240 going to sleep for 11 seconds 00000100:00100000:1.0:1790710722.314046:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176999168 00000100:00100000:1.0:1790710722.314050:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176999168 00000100:00100000:1.0:1790710722.314119:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1790710722.314150:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ee788c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+14:5842:x1877696176999168:12345-0@lo:503: 00000100:00100000:1.0:1790710722.314421:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ee788c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+14:5842:x1877696176999168:12345-0@lo:503: Request processed in 294us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710722.314428:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1790710722.314509:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f8ce5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696176999168:0@lo:503: 00000100:00100000:3.0:1790710722.314709:0:8054:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f8ce5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d27fc27-b651-404a-bd8c-b798806fb18a:8054:1877696176999296:0@lo:502: 00000100:00100000:3.0:1790710722.314759:0:8054:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710722.325380:0:8054:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c2bb6780 going to sleep for 11 seconds 00000100:00100000:2.0:1790710722.328231:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176999296 00000100:00100000:2.0:1790710722.328247:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176999296 00000100:00100000:2.0:1790710722.328308:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1790710722.328317:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ee789450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+14:8054:x1877696176999296:12345-0@lo:502: 00000100:00100000:2.0:1790710722.328684:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ee789450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+14:8054:x1877696176999296:12345-0@lo:502: Request processed in 366us (13935us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710722.328692:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1790710722.330446:0:8054:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f8ce5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d27fc27-b651-404a-bd8c-b798806fb18a:8054:1877696176999296:0@lo:502: 00000100:00100000:3.0:1790710722.330530:0:8054:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f8ce5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d27fc27-b651-404a-bd8c-b798806fb18a:8054:1877696176999424:0@lo:502: 00000100:00100000:3.0:1790710722.330595:0:8054:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710722.330630:0:8054:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c2bb6780 going to sleep for 11 seconds 00000100:00100000:1.0:1790710722.330791:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176999424 00000100:00100000:1.0:1790710722.330798:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176999424 00000100:00100000:1.0:1790710722.330858:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1790710722.330869:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ee78bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+14:8054:x1877696176999424:12345-0@lo:502: 00000100:00100000:1.0:1790710722.332611:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ee78bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+14:8054:x1877696176999424:12345-0@lo:502: Request processed in 1739us (2012us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710722.332624:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1790710722.332704:0:8054:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f8ce5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d27fc27-b651-404a-bd8c-b798806fb18a:8054:1877696176999424:0@lo:502: 00000040:00080000:3.0:1790710722.332745:0:8054:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1790710722.333621:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1790710722.333646:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790710722.333657:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c13fd200/0xcbad34b281570c5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570c62 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710722.333668:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.146@tcp lock: ffff9c51c13fd200/0xcbad34b281570c5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570c62 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790710722.333694:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1790710722.333697:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1790710722.333699:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1790710722.333730:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c0030c00/0xcbad34b281570c69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710722.333737:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.146@tcp lock: ffff9c51c0030c00/0xcbad34b281570c69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710722.333746:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.146@tcp lock: ffff9c51c0030c00/0xcbad34b281570c69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710722.333763:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9577b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696176999552:0@lo:101: 00000100:00100000:0.0:1790710722.333805:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710722.333836:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c5f57300 going to sleep for 11 seconds 00000100:00100000:1.0:1790710722.334227:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176999552 00000100:00100000:1.0:1790710722.334234:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176999552 00000100:00100000:1.0:1790710722.334270:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1790710722.334277:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ee78a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+14:5842:x1877696176999552:12345-0@lo:101: 00010000:00010000:1.0:1790710722.334290:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790710722.334301:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c51c1645a00/0xcbad34b281570c70 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbad34b281570c69 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710722.334324:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c51c1645a00/0xcbad34b281570c70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbad34b281570c69 expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710722.334333:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c51c1645a00/0xcbad34b281570c70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281570c69 expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710722.334341:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c1645a00, rc 0) 00000100:00100000:1.0:1790710722.334396:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ee78a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+15:5842:x1877696176999552:12345-0@lo:101: Request processed in 118us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710722.334403:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1790710722.334968:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9577b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696176999552:0@lo:101: 00010000:00010000:2.0:1790710722.334986:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.146@tcp lock: ffff9c51c0030c00/0xcbad34b281570c69 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570c70 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710722.334996:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.146@tcp lock: ffff9c51c0030c00/0xcbad34b281570c69 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbad34b281570c70 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710722.335055:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c8e8ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696176999680:0@lo:501: 00000100:00100000:2.0:1790710722.335087:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710722.335123:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f9f1ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1790710722.335182:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176999680 00000100:00100000:1.0:1790710722.335189:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176999680 00000100:00100000:1.0:1790710722.335219:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1790710722.335227:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ee78b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+15:5842:x1877696176999680:12345-0@lo:501: 00000100:00100000:1.0:1790710722.335473:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ee78b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+15:5842:x1877696176999680:12345-0@lo:501: Request processed in 246us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710722.335486:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1790710722.337327:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c8e8ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696176999680:0@lo:501: 00000100:00100000:2.0:1790710722.337383:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c8e8ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696176999808:0@lo:503: 00000100:00100000:2.0:1790710722.337448:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710722.337483:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f9f1ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1790710722.337872:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176999808 00000100:00100000:3.0:1790710722.337880:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176999808 00000100:00100000:3.0:1790710722.337949:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1790710722.337959:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ee78a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+15:5842:x1877696176999808:12345-0@lo:503: 00000100:00100000:3.0:1790710722.338335:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ee78a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+15:5842:x1877696176999808:12345-0@lo:503: Request processed in 377us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710722.338342:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1790710722.338392:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c8e8ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696176999808:0@lo:503: 00000100:00100000:2.0:1790710722.339757:0:8055:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c8e8ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d27fc27-b651-404a-bd8c-b798806fb18a:8055:1877696176999936:0@lo:502: 00000100:00100000:2.0:1790710722.339818:0:8055:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710722.339917:0:8055:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f9f1cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1790710722.340036:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696176999936 00000100:00100000:0.0:1790710722.340043:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696176999936 00000100:00100000:0.0:1790710722.340092:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1790710722.340101:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ee788450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+15:8055:x1877696176999936:12345-0@lo:502: 00000100:00100000:0.0:1790710722.340796:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ee788450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+15:8055:x1877696176999936:12345-0@lo:502: Request processed in 694us (975us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710722.340804:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1790710722.340953:0:8055:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c8e8ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d27fc27-b651-404a-bd8c-b798806fb18a:8055:1877696176999936:0@lo:502: 00000020:01000000:2.0:1790710722.340987:0:8055:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790710722.340996:0:8055:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790710722.340999:0:8055:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1790710722.341005:0:8055:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1790710722.341006:0:8055:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1790710722.341027:0:8055:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c8e8ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d27fc27-b651-404a-bd8c-b798806fb18a:8055:1877696177000064:0@lo:502: 00000100:00100000:2.0:1790710722.341063:0:8055:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710722.341100:0:8055:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f9f1cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1790710722.341170:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177000064 00000100:00100000:1.0:1790710722.341175:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177000064 00000100:00100000:1.0:1790710722.341203:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1790710722.341209:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ee788850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+15:8055:x1877696177000064:12345-0@lo:502: 00000100:00100000:1.0:1790710722.341337:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ee788850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+15:8055:x1877696177000064:12345-0@lo:502: Request processed in 128us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710722.341344:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1790710722.341418:0:8055:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c8e8ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d27fc27-b651-404a-bd8c-b798806fb18a:8055:1877696177000064:0@lo:502: 00000020:01000000:2.0:1790710722.341436:0:8055:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790710722.341440:0:8055:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790710722.341441:0:8055:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:2.0:1790710722.341445:0:8055:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:0.0:1790710722.341605:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1790710722.341628:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.146@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1790710722.341637:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c0030c00/0xcbad34b281570c69 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570c70 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710722.341647:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.146@tcp lock: ffff9c51c0030c00/0xcbad34b281570c69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570c70 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790710722.341662:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1790710722.341664:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c51c67ea000 from 30 10000000:01000000:0.0:1790710722.341667:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790710722.341688:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c0030800/0xcbad34b281570c77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710722.341695:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.146@tcp lock: ffff9c51c0030800/0xcbad34b281570c77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710722.341702:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.146@tcp lock: ffff9c51c0030800/0xcbad34b281570c77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710722.341712:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9575500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177000192:0@lo:101: 00000100:00100000:0.0:1790710722.341737:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710722.341753:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c5f57c00 going to sleep for 11 seconds 00000100:00100000:1.0:1790710722.341797:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177000192 00000100:00100000:1.0:1790710722.341801:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177000192 00000100:00100000:1.0:1790710722.341829:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1790710722.341835:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ee78a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+15:5842:x1877696177000192:12345-0@lo:101: 00010000:00010000:1.0:1790710722.341845:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790710722.341856:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c51c1645800/0xcbad34b281570c7e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbad34b281570c77 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710722.341876:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c51c1645800/0xcbad34b281570c7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbad34b281570c77 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710722.341885:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c51c1645800/0xcbad34b281570c7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281570c77 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710722.341892:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c1645800, rc 0) 00000100:00100000:1.0:1790710722.341932:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ee78a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+16:5842:x1877696177000192:12345-0@lo:101: Request processed in 97us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710722.341937:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1790710722.342014:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9575500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177000192:0@lo:101: 00010000:00010000:0.0:1790710722.342026:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.146@tcp lock: ffff9c51c0030800/0xcbad34b281570c77 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570c7e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710722.342034:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.146@tcp lock: ffff9c51c0030800/0xcbad34b281570c77 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbad34b281570c7e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710722.342070:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9575500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177000320:0@lo:501: 00000100:00100000:0.0:1790710722.342092:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710722.342240:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c5f57c00 going to sleep for 11 seconds 00000100:00100000:3.0:1790710722.342276:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177000320 00000100:00100000:3.0:1790710722.342281:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177000320 00000100:00100000:3.0:1790710722.342312:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1790710722.342319:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ee789850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+16:5842:x1877696177000320:12345-0@lo:501: 00000100:00100000:3.0:1790710722.342546:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ee789850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+16:5842:x1877696177000320:12345-0@lo:501: Request processed in 227us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710722.342561:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1790710722.342698:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9575500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177000320:0@lo:501: 00000100:00100000:2.0:1790710722.342727:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c8e8ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177000448:0@lo:503: 00000100:00100000:2.0:1790710722.342762:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710722.342784:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f9f1cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1790710722.342830:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177000448 00000100:00100000:1.0:1790710722.342834:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177000448 00000100:00100000:1.0:1790710722.342868:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1790710722.342874:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ee789050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+16:5842:x1877696177000448:12345-0@lo:503: 00000100:00100000:1.0:1790710722.343014:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ee789050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+16:5842:x1877696177000448:12345-0@lo:503: Request processed in 139us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710722.343020:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1790710722.343091:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c8e8ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177000448:0@lo:503: 00000100:00100000:1.0:1790710722.343521:0:8056:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c812ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d27fc27-b651-404a-bd8c-b798806fb18a:8056:1877696177000576:0@lo:502: 00000100:00100000:1.0:1790710722.343558:0:8056:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710722.343586:0:8056:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c7d4d780 going to sleep for 11 seconds 00000100:00100000:0.0:1790710722.343637:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177000576 00000100:00100000:0.0:1790710722.343642:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177000576 00000100:00100000:0.0:1790710722.343673:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1790710722.343686:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ee78b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+16:8056:x1877696177000576:12345-0@lo:502: 00000100:00100000:0.0:1790710722.343987:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ee78b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+16:8056:x1877696177000576:12345-0@lo:502: Request processed in 300us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710722.343994:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1790710722.344076:0:8056:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c812ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d27fc27-b651-404a-bd8c-b798806fb18a:8056:1877696177000576:0@lo:502: 00000100:00100000:1.0:1790710722.344117:0:8056:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c812ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d27fc27-b651-404a-bd8c-b798806fb18a:8056:1877696177000704:0@lo:502: 00000100:00100000:1.0:1790710722.344278:0:8056:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710722.344295:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177000704 00000100:00100000:1.0:1790710722.344298:0:8056:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c7d4d780 going to sleep for 11 seconds 00000100:00100000:3.0:1790710722.344300:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177000704 00000100:00100000:3.0:1790710722.344324:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1790710722.344331:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ee789c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+16:8056:x1877696177000704:12345-0@lo:502: 00000100:00100000:3.0:1790710722.344480:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ee789c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+16:8056:x1877696177000704:12345-0@lo:502: Request processed in 149us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710722.344486:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1790710722.344750:0:8056:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c812ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d27fc27-b651-404a-bd8c-b798806fb18a:8056:1877696177000704:0@lo:502: 00000040:00080000:1.0:1790710722.344769:0:8056:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1790710722.344928:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1790710722.344946:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790710722.344960:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c0030800/0xcbad34b281570c77 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570c7e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710722.344971:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.146@tcp lock: ffff9c51c0030800/0xcbad34b281570c77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570c7e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790710722.344980:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1790710722.344990:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c51c67ea000 from 5 10000000:01000000:2.0:1790710722.344993:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790710722.345019:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c8047c00/0xcbad34b281570c85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710722.345027:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.146@tcp lock: ffff9c51c8047c00/0xcbad34b281570c85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710722.345036:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.146@tcp lock: ffff9c51c8047c00/0xcbad34b281570c85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710722.345049:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c8e8ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177000832:0@lo:101: 00000100:00100000:2.0:1790710722.345078:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710722.345102:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f9f1cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1790710722.345171:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177000832 00000100:00100000:0.0:1790710722.345176:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177000832 00000100:00100000:0.0:1790710722.345562:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1790710722.345570:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8ff8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+16:5842:x1877696177000832:12345-0@lo:101: 00010000:00010000:0.0:1790710722.345580:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790710722.345592:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c51c0031000/0xcbad34b281570c8c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbad34b281570c85 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710722.345613:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c51c0031000/0xcbad34b281570c8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbad34b281570c85 expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710722.345623:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c51c0031000/0xcbad34b281570c8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281570c85 expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710722.345631:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c0031000, rc 0) 00000100:00100000:0.0:1790710722.345672:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8ff8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+17:5842:x1877696177000832:12345-0@lo:101: Request processed in 103us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710722.345679:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1790710722.345894:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c8e8ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177000832:0@lo:101: 00010000:00010000:2.0:1790710722.345919:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.146@tcp lock: ffff9c51c8047c00/0xcbad34b281570c85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570c8c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710722.345930:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.146@tcp lock: ffff9c51c8047c00/0xcbad34b281570c85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbad34b281570c8c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710722.345978:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c8e8ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177000960:0@lo:256: 00000100:00100000:2.0:1790710722.346010:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710722.346033:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f9f1cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1790710722.346124:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177000960 00000100:00100000:3.0:1790710722.346296:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177000960 00000100:00100000:3.0:1790710722.346322:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1790710722.346329:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8ff8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+17:5842:x1877696177000960:12345-0@lo:256: 20000000:01000000:3.0:1790710722.346352:0:5837:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1790710722.346375:0:5837:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1790710722.346379:0:5837:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1790710722.346465:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8ff8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+17:5842:x1877696177000960:12345-0@lo:256: Request processed in 136us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710722.346472:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1790710722.346676:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c8e8ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177000960:0@lo:256: 10000000:01000000:2.0:1790710722.346714:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.146@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790710722.346721:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c8047c00/0xcbad34b281570c85 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570c8c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710722.346739:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.146@tcp lock: ffff9c51c8047c00/0xcbad34b281570c85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570c8c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790710722.346747:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1790710722.346750:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1790710722.346753:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1790710722.346771:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c8047a00/0xcbad34b281570c93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710722.346778:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.146@tcp lock: ffff9c51c8047a00/0xcbad34b281570c93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710722.346787:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.146@tcp lock: ffff9c51c8047a00/0xcbad34b281570c93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710722.346798:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c8e8ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177001088:0@lo:101: 00000100:00100000:2.0:1790710722.346824:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710722.346845:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f9f1cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1790710722.347879:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177001088 00000100:00100000:1.0:1790710722.347888:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177001088 00000100:00100000:1.0:1790710722.347986:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1790710722.347995:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8ffa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+17:5842:x1877696177001088:12345-0@lo:101: 00010000:00010000:1.0:1790710722.348009:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790710722.348024:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c51c1645400/0xcbad34b281570c9a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbad34b281570c93 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710722.348045:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c51c1645400/0xcbad34b281570c9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbad34b281570c93 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710722.348055:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c51c1645400/0xcbad34b281570c9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281570c93 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710722.348078:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c1645400, rc 0) 00000100:00100000:1.0:1790710722.348161:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8ffa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+18:5842:x1877696177001088:12345-0@lo:101: Request processed in 167us (1335us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710722.348167:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1790710722.348257:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c8e8ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177001088:0@lo:101: 00010000:00010000:2.0:1790710722.348272:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.146@tcp lock: ffff9c51c8047a00/0xcbad34b281570c93 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570c9a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710722.348282:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.146@tcp lock: ffff9c51c8047a00/0xcbad34b281570c93 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbad34b281570c9a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710722.348357:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c8e8ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177001216:0@lo:501: 00000100:00100000:2.0:1790710722.348394:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710722.349037:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f9f1cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1790710722.349116:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177001216 00000100:00100000:3.0:1790710722.349123:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177001216 00000100:00100000:3.0:1790710722.349176:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1790710722.349183:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8ff9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+18:5842:x1877696177001216:12345-0@lo:501: 00000100:00100000:2.0:1790710722.349805:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8ff9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+18:5842:x1877696177001216:12345-0@lo:501: Request processed in 619us (1407us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710722.349813:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1790710722.349894:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c8e8ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177001216:0@lo:501: 00000100:00100000:3.0:1790710722.349944:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f8ce5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177001344:0@lo:503: 00000100:00100000:3.0:1790710722.349986:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710722.350015:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c2bb6cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790710722.350069:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177001344 00000100:00100000:2.0:1790710722.350074:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177001344 00000100:00100000:2.0:1790710722.350094:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1790710722.350100:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8ff9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+18:5842:x1877696177001344:12345-0@lo:503: 00000100:00100000:2.0:1790710722.350587:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8ff9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+18:5842:x1877696177001344:12345-0@lo:503: Request processed in 486us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710722.350595:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1790710722.350714:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f8ce5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177001344:0@lo:503: 00000100:00100000:3.0:1790710722.351149:0:8057:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f8ce5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d27fc27-b651-404a-bd8c-b798806fb18a:8057:1877696177001472:0@lo:502: 00000100:00100000:3.0:1790710722.351194:0:8057:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710722.351221:0:8057:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c2bb6b40 going to sleep for 11 seconds 00000100:00100000:2.0:1790710722.351309:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177001472 00000100:00100000:2.0:1790710722.351314:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177001472 00000100:00100000:2.0:1790710722.351350:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1790710722.351357:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8ffb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+18:8057:x1877696177001472:12345-0@lo:502: 00000100:00100000:2.0:1790710722.351906:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8ffb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+18:8057:x1877696177001472:12345-0@lo:502: Request processed in 539us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710722.351915:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1790710722.352574:0:8057:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f8ce5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d27fc27-b651-404a-bd8c-b798806fb18a:8057:1877696177001472:0@lo:502: 00000020:01000000:2.0:1790710722.352879:0:8057:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1790710722.352887:0:8057:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1790710722.352894:0:8057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790710722.352905:0:8057:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1790710722.352913:0:8057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1790710722.352916:0:8057:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.146@tcp to nid 0x20000c0a8ce92 (192.168.206.146@tcp) 00000020:01000000:2.0:1790710722.352937:0:8057:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1790710722.352940:0:8057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790710722.352953:0:8057:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9c51ff4a8000) 00000020:00000080:2.0:1790710722.352973:0:8057:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1790710722.352979:0:8057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1790710722.353056:0:8057:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1790710722.353062:0:8057:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:2.0:1790710722.353069:0:8057:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcbad34b281570ca8 00010000:00080000:2.0:1790710722.353095:0:8057:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c51f947b800@lustre-OST0001-osc-MDT0000: add connection 192.168.206.146@tcp at head 00010000:00010000:2.0:1790710722.353691:0:8057:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:2.0:1790710722.354020:0:8057:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1790710722.354033:0:8057:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1790710722.354969:0:8057:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790710722.355349:0:8057:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790710722.358721:0:8057:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1790710722.358809:0:8057:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1790710722.359785:0:8058:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790710722.359790:0:8058:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1790710722.366443:0:8057:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1790710722.366459:0:8057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1790710722.366497:0:8057:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1790710722.366518:0:8057:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcbad34b281570caf 00000100:00080000:0.0:1790710722.366528:0:8057:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790710722.366600:0:8057:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c51f947b800 using connection 192.168.206.146@tcp/0@lo 00000100:00100000:0.0:1790710722.366635:0:8057:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c51f9574a80 x1877696177001600/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790710722.366674:0:8057:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:2.0:1790710722.366708:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9574a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1877696177001600:0@lo:8: 00000100:00100000:2.0:1790710722.366789:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1790710722.366858:0:8057:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790710722.366864:0:8057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790710722.366866:0:8057:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1790710722.366869:0:8057:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790710722.366873:0:8057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790710722.366874:0:8057:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1790710722.366877:0:8057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1790710722.366879:0:8057:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1790710722.366908:0:8057:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9574e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d27fc27-b651-404a-bd8c-b798806fb18a:8057:1877696177001856:0@lo:502: 00000100:00100000:1.0:1790710722.366947:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c812f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1877696177001984:0@lo:400: 00000100:00100000:1.0:1790710722.366989:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710722.367012:0:8057:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710722.367013:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790710722.367018:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c812ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877696177001728:0@lo:400: 00000100:00100000:0.0:1790710722.367025:0:8057:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c5f57d80 going to sleep for 11 seconds 00000100:00100000:1.0:1790710722.367039:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710722.367062:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c812ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177002112:0@lo:400: 00000100:00100000:1.0:1790710722.367084:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710722.367103:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790710722.367108:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c812c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1877696177002240:0@lo:400: 00000100:00100000:1.0:1790710722.367153:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710722.367252:0:6696:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177001600 00000100:00100000:3.0:1790710722.367261:0:6696:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177001600 00000100:00100000:3.0:1790710722.367285:0:6696:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177002112 00000100:00100000:3.0:1790710722.367287:0:6696:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177002112 00000100:00100000:3.0:1790710722.367313:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790710722.367332:0:6696:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1877696177002112:12345-0@lo:400: 00000100:00100000:3.0:1790710722.367387:0:6696:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1877696177002112:12345-0@lo:400: Request processed in 57us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710722.367393:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790710722.367405:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790710722.367409:0:6696:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8e8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3308:x1877696177001600:12345-0@lo:8: 00010000:00080000:3.0:1790710722.367428:0:6696:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 199 last 0 00000020:00000080:3.0:1790710722.367449:0:6696:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcbad34b281570cb6 00000100:00080000:2.0:1790710722.367477:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00100000:3.0:1790710722.367501:0:6696:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9c51ff486800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1790710722.367505:0:6696:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:3.0:1790710722.367508:0:6696:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1790710722.367617:0:6696:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1790710722.367744:0:6696:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1790710722.367768:0:6696:0:(import.c:65:import_set_state_nolock()) ffff9c51f3c08800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790710722.367823:0:6696:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8e8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1877696177001600:12345-0@lo:8: Request processed in 412us (1035us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710722.367830:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1790710722.367893:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51f9574a80 x1877696177001600/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790710732 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790710722.367916:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790710722.367923:0:3308:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1790710722.367930:0:3308:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1790710722.367934:0:3308:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1790710722.367936:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9c51f947b800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1790710722.369526:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177001984 00000100:00100000:0.0:1790710722.369548:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177001984 00010000:00080000:1.0:1790710722.369563:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51c812ea00 x1877696177002112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790710738 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790710722.369576:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c812ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177002112:0@lo:400: 00000100:00100000:0.0:1790710722.369592:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177001728 00000100:00100000:0.0:1790710722.369595:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177001728 00000100:00100000:0.0:1790710722.369609:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177002240 00000100:00100000:0.0:1790710722.369611:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177002240 00000100:00100000:1.0:1790710722.369612:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790710722.369620:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1877696177001984:12345-0@lo:400: 00000100:00100000:0.0:1790710722.369623:0:5847:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1790710722.369629:0:5847:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1790710722.369652:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177001856 00000100:00100000:0.0:1790710722.369655:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177001856 00000100:00100000:0.0:1790710722.369676:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1790710722.369677:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1877696177001984:12345-0@lo:400: Request processed in 59us (2689us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710722.369682:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8ff9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+18:8057:x1877696177001856:12345-0@lo:502: 00000100:00100000:1.0:1790710722.369684:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790710722.369706:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790710722.369711:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1877696177001728:12345-0@lo:400: 00000100:00100000:1.0:1790710722.369747:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1877696177001728:12345-0@lo:400: Request processed in 36us (2707us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710722.369753:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790710722.369766:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790710722.369771:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1877696177002240:12345-0@lo:400: 00000100:00100000:1.0:1790710722.369800:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1877696177002240:12345-0@lo:400: Request processed in 29us (2646us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710722.369805:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1790710722.369837:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51c812ed80 x1877696177001728/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790710738 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790710722.369847:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c812ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877696177001728:0@lo:400: 00010000:00080000:1.0:1790710722.369858:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51c812f480 x1877696177001984/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790710738 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790710722.369865:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c812f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1877696177001984:0@lo:400: 00010000:00080000:1.0:1790710722.369888:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51c812c380 x1877696177002240/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790710738 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790710722.369908:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c812c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1877696177002240:0@lo:400: 00000100:00100000:0.0:1790710722.370049:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8ff9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+18:8057:x1877696177001856:12345-0@lo:502: Request processed in 366us (3036us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710722.370057:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1790710722.371466:0:8057:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9574e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d27fc27-b651-404a-bd8c-b798806fb18a:8057:1877696177001856:0@lo:502: 00000020:01000000:1.0:1790710722.371503:0:8057:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790710722.371512:0:8057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790710722.371514:0:8057:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:1.0:1790710722.371518:0:8057:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000004:00080000:2.0:1790710722.371850:0:3308:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1790710722.371860:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9574a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1877696177001600:0@lo:8: 00000020:01000000:0.0:1790710722.371881:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 00000100:00080000:2.0:1790710722.371883:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 10000000:01000000:0.0:1790710722.371973:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.146@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1790710722.371983:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c8047a00/0xcbad34b281570c93 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570c9a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710722.372003:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.146@tcp lock: ffff9c51c8047a00/0xcbad34b281570c93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570c9a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790710722.372012:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1790710722.372014:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9c51d02d19c0 from 1 10000000:01000000:0.0:1790710722.372016:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1790710722.372045:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c0031a00/0xcbad34b281570cbd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710722.372052:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.146@tcp lock: ffff9c51c0031a00/0xcbad34b281570cbd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710722.372061:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.146@tcp lock: ffff9c51c0031a00/0xcbad34b281570cbd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710722.372076:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9577100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177002368:0@lo:101: 00000100:00100000:0.0:1790710722.372124:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710722.372168:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c5f57b40 going to sleep for 11 seconds 00000100:00100000:2.0:1790710722.372724:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177002368 00000100:00100000:2.0:1790710722.372732:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177002368 00000100:00100000:2.0:1790710722.372777:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1790710722.372785:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8ff8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+18:5842:x1877696177002368:12345-0@lo:101: 00010000:00010000:2.0:1790710722.372799:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790710722.372819:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c51c8047200/0xcbad34b281570cc4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbad34b281570cbd expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710722.372842:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c51c8047200/0xcbad34b281570cc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbad34b281570cbd expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710722.372851:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c51c8047200/0xcbad34b281570cc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281570cbd expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710722.372860:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c8047200, rc 0) 00000100:00100000:2.0:1790710722.372917:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8ff8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+19:5842:x1877696177002368:12345-0@lo:101: Request processed in 131us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710722.372923:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1790710722.372966:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9577100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177002368:0@lo:101: 00010000:00010000:2.0:1790710722.372981:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.146@tcp lock: ffff9c51c0031a00/0xcbad34b281570cbd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570cc4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710722.372988:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.146@tcp lock: ffff9c51c0031a00/0xcbad34b281570cbd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbad34b281570cc4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710722.373038:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c8e8c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177002496:0@lo:501: 00000100:00100000:2.0:1790710722.373064:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710722.373083:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f9f1c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790710722.373095:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177002496 00000100:00100000:2.0:1790710722.373098:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177002496 00000100:00100000:2.0:1790710722.373144:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1790710722.373151:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8ffb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+19:5842:x1877696177002496:12345-0@lo:501: 00000100:00100000:2.0:1790710722.373485:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8ffb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+19:5842:x1877696177002496:12345-0@lo:501: Request processed in 219us (305us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790710722.373503:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1790710722.373535:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c8e8c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177002496:0@lo:501: 10000000:01000000:2.0:1790710722.373555:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.146@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1790710722.373562:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c0031a00/0xcbad34b281570cbd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570cc4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710722.373569:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.146@tcp lock: ffff9c51c0031a00/0xcbad34b281570cbd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570cc4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790710722.374533:0:8058:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1790710722.374645:0:8058:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 199711517233ns, next at 0ns, rc = 0 00000004:00080000:3.0:1790710722.483638:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1790710722.527908:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000004:00080000:1.0:1790710722.527930:0:8059:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1790710722.527962:0:8059:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d65500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8059:1877696177002752:0@lo:7: 00000100:00100000:1.0:1790710722.528021:0:8059:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710722.528058:0:8059:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51d9033a80 going to sleep for 11 seconds 00000100:00100000:1.0:1790710722.528074:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177002752 00000100:00100000:1.0:1790710722.528080:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177002752 00000100:00100000:1.0:1790710722.528148:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790710722.528156:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8059:x1877696177002752:12345-0@lo:7: 00000100:00100000:2.0:1790710722.532024:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1877696177002624:0@lo:13: 00000100:00100000:2.0:1790710722.532091:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710722.533414:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177002624 00000100:00100000:3.0:1790710722.533424:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177002624 00000100:00100000:3.0:1790710722.533471:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790710722.533479:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8e8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1877696177002624:12345-0@lo:13: 00002000:00000024:3.0:1790710722.533507:0:6700:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1790710722.533568:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8e8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1877696177002624:12345-0@lo:13: Request processed in 90us (1477us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710722.533576:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1790710722.533663:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51f4d67b80 x1877696177002624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790710738 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790710722.533682:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1877696177002624:0@lo:13: 00002000:00080000:1.0:1790710722.534517:0:6698:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1790710722.534523:0:6698:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1790710722.534628:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8059:x1877696177002752:12345-0@lo:7: Request processed in 6471us (6605us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710722.534638:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1790710722.534665:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1790710722.537359:0:8059:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51f4d65500 x1877696177002752/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790710738 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790710722.537378:0:8059:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d65500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8059:1877696177002752:0@lo:7: 00000004:00080000:2.0:1790710722.537393:0:8059:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1790710722.537434:0:8059:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c8e8f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8059:1877696177002880:0@lo:5: 00000100:00100000:2.0:1790710722.537486:0:8059:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710722.537523:0:8059:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51d03cff00 going to sleep for 11 seconds 00000100:00100000:2.0:1790710722.539626:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177002880 00000100:00100000:2.0:1790710722.539639:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177002880 00000100:00100000:2.0:1790710722.539739:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790710722.539749:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8e8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8059:x1877696177002880:12345-0@lo:5: 00002000:00080000:2.0:1790710722.539797:0:6697:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1790710722.539801:0:6697:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1790710722.540158:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8e8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:8059:x1877696177002880:12345-0@lo:5: Request processed in 410us (2670us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1790710722.540166:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1790710722.543387:0:8059:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51c8e8f800 x1877696177002880/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790710738 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790710722.543409:0:8059:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c8e8f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8059:1877696177002880:0@lo:5: 00000004:00080000:3.0:1790710722.543423:0:8059:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1790710722.543463:0:8059:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f8ce5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8059:1877696177003008:0@lo:700: 00000100:00100000:3.0:1790710722.543517:0:8059:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710722.543553:0:8059:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c679c180 going to sleep for 11 seconds 00000100:00100000:3.0:1790710722.543570:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177003008 00000100:00100000:3.0:1790710722.543575:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177003008 00000100:00100000:3.0:1790710722.543627:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790710722.543637:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f8ce5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8059:x1877696177003008:12345-0@lo:700: 00000100:00100000:3.0:1790710722.543671:0:6704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f8ce4000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6704:1877696177003136:0@lo:700: 00000100:00100000:3.0:1790710722.543700:0:6704:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710722.543729:0:6704:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c679ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1790710722.544078:0:5852:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177003136 00000100:00100000:2.0:1790710722.544084:0:5852:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177003136 00000100:00100000:2.0:1790710722.544121:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790710722.544149:0:5852:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f8ce6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6704:x1877696177003136:12345-0@lo:700: 40000000:02000000:2.0:1790710722.610468:0:5852:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:2.0:1790710722.620611:0:5852:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f8ce6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6704:x1877696177003136:12345-0@lo:700: Request processed in 76478us (76903us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710722.620623:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1790710722.620679:0:6704:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51f8ce4000 x1877696177003136/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1790710738 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790710722.620692:0:6704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f8ce4000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6704:1877696177003136:0@lo:700: 40000000:02000000:2.0:1790710722.620706:0:6704:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:2.0:1790710722.702456:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f8ce5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8059:x1877696177003008:12345-0@lo:700: Request processed in 158812us (158929us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710722.702472:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000001:00080000:0.0:1790710722.702558:0:7643:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:0.0:1790710722.702568:0:7643:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:3.0:1790710722.702640:0:8059:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51f8ce5880 x1877696177003008/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1790710738 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790710722.702654:0:8059:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f8ce5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8059:1877696177003008:0@lo:700: 00000004:02000040:3.0:1790710722.735082:0:8059:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:3.0:1790710722.747685:0:8059:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f8ce5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8059:1877696177003264:0@lo:5: 00000100:00100000:3.0:1790710722.747769:0:8059:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710722.747815:0:6696:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177003264 00000100:00100000:3.0:1790710722.747822:0:6696:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177003264 00000100:00100000:3.0:1790710722.747879:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790710722.747888:0:6696:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f8ce4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8059:x1877696177003264:12345-0@lo:5: 00000100:00100000:2.0:1790710722.748456:0:8059:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51ff47e0c0 going to sleep for 11 seconds 00002000:00080000:3.0:1790710722.761003:0:6696:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1790710722.761022:0:6696:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1790710722.765502:0:6696:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f8ce4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8059:x1877696177003264:12345-0@lo:5: Request processed in 17609us (17740us total) trans 4294967298 rc 0/0 00010000:00080000:0.0:1790710722.765630:0:8059:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51f8ce5880 x1877696177003264/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790710738 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790710722.765645:0:8059:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1790710722.765660:0:8059:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9c51f8ce5880 x1877696177003264/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790710738 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790710722.765671:0:8059:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f8ce5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8059:1877696177003264:0@lo:5: 00000004:00080000:0.0:1790710722.765686:0:8059:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:3.0:1790710722.765734:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:0.0:1790710723.079413:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790710723.340172:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1877696177003392:0@lo:13: 00000100:00100000:2.0:1790710723.340239:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710723.340378:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177003392 00000100:00100000:0.0:1790710723.340386:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177003392 00000100:00100000:0.0:1790710723.340437:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790710723.340446:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8e8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877696177003392:12345-0@lo:13: 00002000:00000024:0.0:1790710723.340479:0:6700:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790710723.340528:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8e8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877696177003392:12345-0@lo:13: Request processed in 83us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710723.340535:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1790710723.340704:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51f4d67100 x1877696177003392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790710739 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790710723.340971:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1877696177003392:0@lo:13: 00010000:00010000:2.0:1790710724.104822:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790710725.127438:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1790710725.868685:0:7643:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:0.0:1790710726.151632:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790710726.346544:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710726.346650:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158105728 00000100:00100000:2.0:1790710726.346672:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158105728 00000100:00100000:2.0:1790710726.346933:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 112 00000100:00100000:2.0:1790710726.346942:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8ffac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2355:x1877696158105728:12345-192.168.206.46@tcp:250: 00010000:00080000:2.0:1790710726.346967:0:5838:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 2b75d7a5-152f-4db9-bf19-5fe279a322e3@192.168.206.46@tcp t0 exp 0000000000000000 cur 203 last 0 00000020:00000080:2.0:1790710726.346991:0:5838:0:(genops.c:1384:class_connect()) connect: client 2b75d7a5-152f-4db9-bf19-5fe279a322e3, cookie 0xcbad34b281570ccb 00000100:00080000:2.0:1790710726.347143:0:5838:0:(import.c:65:import_set_state_nolock()) ffff9c51ff4b1800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790710726.347204:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8ffac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b75d7a5-152f-4db9-bf19-5fe279a322e3+5:2355:x1877696158105728:12345-192.168.206.46@tcp:250: Request processed in 261us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710726.347212:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 112 00000100:00100000:0.0:1790710726.356464:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710726.356672:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158105856 00000100:00100000:1.0:1790710726.356682:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158105856 00000100:00100000:1.0:1790710726.356836:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 113 00000100:00100000:1.0:1790710726.356847:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8ff8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b75d7a5-152f-4db9-bf19-5fe279a322e3+5:5582:x1877696158105856:12345-192.168.206.46@tcp:101: 00010000:00010000:1.0:1790710726.356864:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790710726.356888:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c51c6481000/0xcbad34b281570cd2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x566877b0570002e9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710726.356913:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c51c6481000/0xcbad34b281570cd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570002e9 expref: 6 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710726.356936:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c51c6481000/0xcbad34b281570cd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570002e9 expref: 6 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710726.356945:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c6481000, rc 0) 00000100:00100000:1.0:1790710726.356990:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8ff8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b75d7a5-152f-4db9-bf19-5fe279a322e3+6:5582:x1877696158105856:12345-192.168.206.46@tcp:101: Request processed in 146us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710726.357334:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 113 00000100:00100000:2.0:1790710726.362565:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710726.362770:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158105984 00000100:00100000:0.0:1790710726.362779:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158105984 00000100:00100000:0.0:1790710726.362916:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 114 00000100:00100000:0.0:1790710726.362927:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8ff9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b75d7a5-152f-4db9-bf19-5fe279a322e3+6:5582:x1877696158105984:12345-192.168.206.46@tcp:501: 00000100:00100000:0.0:1790710726.363473:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8ff9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b75d7a5-152f-4db9-bf19-5fe279a322e3+6:5582:x1877696158105984:12345-192.168.206.46@tcp:501: Request processed in 545us (914us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790710726.363482:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 114 00000100:00100000:0.0:1790710726.370731:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710726.371394:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158106112 00000100:00100000:1.0:1790710726.371405:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158106112 00000100:00100000:1.0:1790710726.371455:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 115 00000100:00100000:1.0:1790710726.371464:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8ffbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b75d7a5-152f-4db9-bf19-5fe279a322e3+6:5582:x1877696158106112:12345-192.168.206.46@tcp:101: 00010000:00010000:1.0:1790710726.371479:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790710726.371496:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c51c6480800/0xcbad34b281570cd9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x566877b0570002f0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710726.371523:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c51c6480800/0xcbad34b281570cd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570002f0 expref: 7 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710726.371534:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c51c6480800/0xcbad34b281570cd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570002f0 expref: 7 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710726.371606:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c6480800, rc 0) 00000100:00100000:1.0:1790710726.371694:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8ffbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b75d7a5-152f-4db9-bf19-5fe279a322e3+7:5582:x1877696158106112:12345-192.168.206.46@tcp:101: Request processed in 201us (942us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710726.371702:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 115 00000100:00100000:2.0:1790710726.377966:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710726.378086:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158106240 00000100:00100000:0.0:1790710726.378096:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158106240 00000100:00100000:0.0:1790710726.378168:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 116 00000100:00100000:0.0:1790710726.378178:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8ffa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b75d7a5-152f-4db9-bf19-5fe279a322e3+7:5582:x1877696158106240:12345-192.168.206.46@tcp:501: 00000100:00100000:0.0:1790710726.378418:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8ffa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b75d7a5-152f-4db9-bf19-5fe279a322e3+8:5582:x1877696158106240:12345-192.168.206.46@tcp:501: Request processed in 241us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710726.378426:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 116 00000100:00100000:2.0:1790710726.380861:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710726.380948:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158106368 00000100:00100000:0.0:1790710726.380957:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158106368 00000100:00100000:0.0:1790710726.381150:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 117 00000100:00100000:0.0:1790710726.381161:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8ffb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b75d7a5-152f-4db9-bf19-5fe279a322e3+8:5582:x1877696158106368:12345-192.168.206.46@tcp:503: 00000100:00100000:0.0:1790710726.381478:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8ffb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b75d7a5-152f-4db9-bf19-5fe279a322e3+8:5582:x1877696158106368:12345-192.168.206.46@tcp:503: Request processed in 319us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710726.381487:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 117 00000100:00100000:0.0:1790710726.394265:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710726.394874:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158106496 00000100:00100000:3.0:1790710726.394894:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158106496 00000100:00100000:2.0:1790710726.395006:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 118 00000100:00100000:2.0:1790710726.395017:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8ffa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b75d7a5-152f-4db9-bf19-5fe279a322e3+8:5601:x1877696158106496:12345-192.168.206.46@tcp:502: 00000100:00100000:2.0:1790710726.395540:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8ffa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b75d7a5-152f-4db9-bf19-5fe279a322e3+8:5601:x1877696158106496:12345-192.168.206.46@tcp:502: Request processed in 522us (1295us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710726.395548:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 118 00000100:00100000:2.0:1790710726.419195:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710726.419277:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158106624 00000100:00100000:0.0:1790710726.419286:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158106624 00000100:00100000:0.0:1790710726.419342:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 119 00000100:00100000:0.0:1790710726.419353:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ee72a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b75d7a5-152f-4db9-bf19-5fe279a322e3+8:5601:x1877696158106624:12345-192.168.206.46@tcp:502: 00000100:00100000:0.0:1790710726.419667:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ee72a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b75d7a5-152f-4db9-bf19-5fe279a322e3+8:5601:x1877696158106624:12345-192.168.206.46@tcp:502: Request processed in 314us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710726.419675:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 119 00000100:00100000:0.0:1790710726.436651:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710726.436785:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158106752 00000100:00100000:1.0:1790710726.436795:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158106752 00000100:00100000:1.0:1790710726.436859:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 120 00000100:00100000:1.0:1790710726.436868:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ee72a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b75d7a5-152f-4db9-bf19-5fe279a322e3+8:5582:x1877696158106752:12345-192.168.206.46@tcp:101: 00010000:00010000:1.0:1790710726.436895:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790710726.436912:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c51c6480000/0xcbad34b281570ce0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x566877b05700031a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710726.436939:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c51c6480000/0xcbad34b281570ce0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700031a expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710726.436950:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c51c6480000/0xcbad34b281570ce0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700031a expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710726.436960:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c6480000, rc 0) 00000100:00100000:1.0:1790710726.437022:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ee72a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b75d7a5-152f-4db9-bf19-5fe279a322e3+9:5582:x1877696158106752:12345-192.168.206.46@tcp:101: Request processed in 154us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710726.437030:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 120 00000100:00100000:2.0:1790710726.442257:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710726.442288:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158106880 00000100:00100000:2.0:1790710726.442298:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158106880 00000100:00100000:2.0:1790710726.442346:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 121 00000100:00100000:2.0:1790710726.442356:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c64efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b75d7a5-152f-4db9-bf19-5fe279a322e3+9:5582:x1877696158106880:12345-192.168.206.46@tcp:256: 20000000:01000000:2.0:1790710726.442379:0:5837:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1790710726.442401:0:5837:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1790710726.442405:0:5837:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1790710726.442618:0:5837:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1790710726.442621:0:5837:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1790710726.446534:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c64efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b75d7a5-152f-4db9-bf19-5fe279a322e3+9:5582:x1877696158106880:12345-192.168.206.46@tcp:256: Request processed in 4169us (4273us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710726.446549:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 121 00000100:00100000:3.0:1790710726.451890:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710726.451924:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158107008 00000100:00100000:3.0:1790710726.451935:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158107008 00000100:00100000:3.0:1790710726.451975:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 122 00000100:00100000:3.0:1790710726.451984:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c64ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b75d7a5-152f-4db9-bf19-5fe279a322e3+9:5582:x1877696158107008:12345-192.168.206.46@tcp:101: 00010000:00010000:3.0:1790710726.452000:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790710726.452017:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c51c13fcc00/0xcbad34b281570ce7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x566877b057000321 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710726.452044:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c51c13fcc00/0xcbad34b281570ce7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000321 expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710726.452065:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c51c13fcc00/0xcbad34b281570ce7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000321 expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710726.452076:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c13fcc00, rc 0) 00000100:00100000:3.0:1790710726.452191:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c64ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b75d7a5-152f-4db9-bf19-5fe279a322e3+10:5582:x1877696158107008:12345-192.168.206.46@tcp:101: Request processed in 207us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710726.452198:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 122 00000100:00100000:0.0:1790710726.456955:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710726.458311:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158107136 00000100:00100000:0.0:1790710726.458322:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158107136 00000100:00100000:0.0:1790710726.458381:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 123 00000100:00100000:0.0:1790710726.458391:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c64ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b75d7a5-152f-4db9-bf19-5fe279a322e3+10:5582:x1877696158107136:12345-192.168.206.46@tcp:501: 00000100:00100000:0.0:1790710726.458702:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c64ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b75d7a5-152f-4db9-bf19-5fe279a322e3+10:5582:x1877696158107136:12345-192.168.206.46@tcp:501: Request processed in 311us (1753us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710726.458709:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 123 00000100:00100000:2.0:1790710726.461561:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710726.461713:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158107264 00000100:00100000:0.0:1790710726.461722:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158107264 00000100:00100000:0.0:1790710726.461798:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 124 00000100:00100000:0.0:1790710726.461807:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c64ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b75d7a5-152f-4db9-bf19-5fe279a322e3+10:5582:x1877696158107264:12345-192.168.206.46@tcp:503: 00000100:00100000:0.0:1790710726.462161:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c64ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b75d7a5-152f-4db9-bf19-5fe279a322e3+10:5582:x1877696158107264:12345-192.168.206.46@tcp:503: Request processed in 354us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710726.462170:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 124 00000100:00100000:0.0:1790710726.467396:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710726.467475:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158107392 00000100:00100000:2.0:1790710726.467483:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158107392 00000100:00100000:2.0:1790710726.467533:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 125 00000100:00100000:2.0:1790710726.467543:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c64ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b75d7a5-152f-4db9-bf19-5fe279a322e3+10:5606:x1877696158107392:12345-192.168.206.46@tcp:502: 00000100:00100000:2.0:1790710726.467919:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c64ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b75d7a5-152f-4db9-bf19-5fe279a322e3+10:5606:x1877696158107392:12345-192.168.206.46@tcp:502: Request processed in 376us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710726.467927:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 125 00000100:00100000:0.0:1790710726.470557:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710726.471059:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158107520 00000100:00100000:2.0:1790710726.471068:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158107520 00000100:00100000:2.0:1790710726.471113:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 126 00000100:00100000:2.0:1790710726.471122:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c64ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b75d7a5-152f-4db9-bf19-5fe279a322e3+10:5606:x1877696158107520:12345-192.168.206.46@tcp:502: 00000100:00100000:2.0:1790710726.471337:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c64ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b75d7a5-152f-4db9-bf19-5fe279a322e3+10:5606:x1877696158107520:12345-192.168.206.46@tcp:502: Request processed in 215us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710726.471345:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 126 00000100:00100000:0.0:1790710726.475692:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710726.475754:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158107648 00000100:00100000:1.0:1790710726.475763:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158107648 00000100:00100000:1.0:1790710726.475807:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 4 00000100:00100000:1.0:1790710726.475815:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9574000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2355:x1877696158107648:12345-192.168.206.46@tcp:38: 00010000:00080000:1.0:1790710726.475845:0:5846:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 0ec73bd1-726e-4dc0-8edd-807d3f973d65@192.168.206.46@tcp t0 exp 0000000000000000 cur 203 last 0 00000020:00000080:1.0:1790710726.475894:0:5846:0:(genops.c:1384:class_connect()) connect: client 0ec73bd1-726e-4dc0-8edd-807d3f973d65, cookie 0xcbad34b281570cee 00000004:00100000:1.0:1790710726.475922:0:5846:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1790710726.475929:0:5846:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:3.0:1790710726.507291:0:5846:0:(import.c:65:import_set_state_nolock()) ffff9c51f49af000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790710726.507547:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9574000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:2355:x1877696158107648:12345-192.168.206.46@tcp:38: Request processed in 31729us (31860us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710726.507559:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 4 00010000:00010000:0.0:1790710727.175330:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790710727.431979:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f8ce4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1877696177003648:0@lo:400: 00000100:00100000:0.0:1790710727.432053:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710727.432119:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f8ce7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1877696177004160:0@lo:400: 00000100:00100000:0.0:1790710727.432195:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710727.432223:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1790710727.432228:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f8ce6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d27fc27-b651-404a-bd8c-b798806fb18a:3312:1877696177003520:0@lo:400: 00000100:00100000:0.0:1790710727.432253:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710727.432268:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f8ce4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1877696177004032:0@lo:400: 00000100:00100000:0.0:1790710727.432285:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710727.432337:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177003648 00000100:00100000:0.0:1790710727.432352:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177003648 00000100:00100000:0.0:1790710727.432397:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177004032 00000100:00100000:0.0:1790710727.432400:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177004032 00000100:00100000:0.0:1790710727.432425:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790710727.432435:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9576300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1877696177003648:12345-0@lo:400: 00000100:00100000:0.0:1790710727.432482:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9576300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1877696177003648:12345-0@lo:400: Request processed in 48us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710727.432489:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790710727.432636:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790710727.432644:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9577100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1877696177004032:12345-0@lo:400: 00000100:00100000:0.0:1790710727.432672:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9577100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1877696177004032:12345-0@lo:400: Request processed in 30us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710727.432678:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1790710727.432711:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51f8ce4380 x1877696177004032/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790710743 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790710727.432724:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f8ce4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1877696177004032:0@lo:400: 00010000:00080000:0.0:1790710727.432734:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51f8ce4e00 x1877696177003648/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790710743 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790710727.432743:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f8ce4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1877696177003648:0@lo:400: 00000100:00100000:2.0:1790710727.433069:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f8ce4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1877696177003776:0@lo:400: 00000100:00100000:2.0:1790710727.433101:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710727.433195:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790710727.433202:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f8ce5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1877696177003904:0@lo:400: 00000100:00100000:2.0:1790710727.433228:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710727.433256:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177004160 00000100:00100000:2.0:1790710727.433261:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177004160 00000100:00100000:2.0:1790710727.433302:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177003904 00000100:00100000:2.0:1790710727.433306:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177003904 00000100:00080000:1.0:1790710727.433681:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790710727.433685:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790710727.433688:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790710727.433712:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177003520 00000100:00100000:1.0:1790710727.433722:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177003520 00000100:00100000:1.0:1790710727.433751:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1790710727.433759:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c64ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+19:3312:x1877696177003520:12345-0@lo:400: 00000100:00100000:1.0:1790710727.433803:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c64ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+19:3312:x1877696177003520:12345-0@lo:400: Request processed in 45us (1548us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710727.433810:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1790710727.433966:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790710727.433974:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9577800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1877696177004160:12345-0@lo:400: 00000100:00100000:1.0:1790710727.434006:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9577800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1877696177004160:12345-0@lo:400: Request processed in 34us (1811us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710727.434012:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790710727.434028:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790710727.434034:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8e8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1877696177003904:12345-0@lo:400: 00000100:00100000:1.0:1790710727.434068:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8e8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1877696177003904:12345-0@lo:400: Request processed in 35us (838us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710727.434075:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1790710727.434112:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51f8ce5180 x1877696177003904/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790710743 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790710727.434123:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f8ce5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1877696177003904:0@lo:400: 00000100:00100000:3.0:1790710727.434337:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177003776 00000100:00100000:3.0:1790710727.434350:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177003776 00000100:00100000:3.0:1790710727.434392:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790710727.434399:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8e8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877696177003776:12345-0@lo:400: 00000100:00100000:3.0:1790710727.434440:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8e8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877696177003776:12345-0@lo:400: Request processed in 42us (1338us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710727.434446:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1790710727.434476:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51f8ce4700 x1877696177003776/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790710743 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790710727.434486:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f8ce4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1877696177003776:0@lo:400: 00000100:00100000:0.0:1790710727.434884:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f8ce6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d27fc27-b651-404a-bd8c-b798806fb18a:3312:1877696177003520:0@lo:400: 00010000:00080000:0.0:1790710727.434898:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51f8ce7480 x1877696177004160/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790710743 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790710727.434906:0:3312:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1790710727.434914:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f8ce7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1877696177004160:0@lo:400: 00000100:00080000:1.0:1790710727.435267:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790710727.520399:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710727.520432:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710727.520522:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158107776 00000100:00100000:0.0:1790710727.520531:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158107776 00000100:00100000:0.0:1790710727.520605:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158107904 00000100:00100000:0.0:1790710727.520608:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158107904 00000100:00100000:0.0:1790710727.520633:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 5 00000100:00100000:0.0:1790710727.520644:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8e8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+7:0:x1877696158107776:12345-192.168.206.46@tcp:41: 00000004:00000024:0.0:1790710727.520687:0:5846:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00080000:1.0:1790710727.520882:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790710727.520913:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 6 00000100:00100000:1.0:1790710727.520922:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8e8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+7:5582:x1877696158107904:12345-192.168.206.46@tcp:41: 00000004:00000024:1.0:1790710727.520936:0:8060:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1790710727.520999:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8e8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+7:0:x1877696158107776:12345-192.168.206.46@tcp:41: Request processed in 356us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710727.521023:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 5 00000100:00100000:1.0:1790710727.526643:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8e8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:5582:x1877696158107904:12345-192.168.206.46@tcp:41: Request processed in 5705us (6192us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710727.526678:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 6 00000100:00100000:0.0:1790710727.536000:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710727.536241:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158108032 00000100:00100000:3.0:1790710727.536250:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158108032 00000100:00100000:3.0:1790710727.536302:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 7 00000100:00100000:3.0:1790710727.536313:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9574a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:5582:x1877696158108032:12345-192.168.206.46@tcp:40: 00000100:00100000:3.0:1790710727.536637:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9574a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:5582:x1877696158108032:12345-192.168.206.46@tcp:40: Request processed in 325us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710727.536645:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 7 00000100:00100000:0.0:1790710727.542054:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710727.542505:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710727.542536:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710727.542571:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710727.542700:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158108544 00000100:00100000:2.0:1790710727.542724:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158108544 00000100:00100000:2.0:1790710727.542777:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 128 00000100:00100000:2.0:1790710727.542786:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c64e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b75d7a5-152f-4db9-bf19-5fe279a322e3+10:2357:x1877696158108544:12345-192.168.206.46@tcp:400: 00000100:00100000:2.0:1790710727.542851:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c64e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b75d7a5-152f-4db9-bf19-5fe279a322e3+10:2357:x1877696158108544:12345-192.168.206.46@tcp:400: Request processed in 66us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710727.542858:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 128 00000100:00100000:2.0:1790710727.542981:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158108160 00000100:00100000:2.0:1790710727.542985:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158108160 00000100:00100000:2.0:1790710727.543000:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158108288 00000100:00100000:2.0:1790710727.543003:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158108288 00000100:00100000:2.0:1790710727.543026:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 8 00000100:00100000:2.0:1790710727.543032:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9575500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2355:x1877696158108160:12345-192.168.206.46@tcp:8: 00010000:00080000:2.0:1790710727.543066:0:6697:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 0ec73bd1-726e-4dc0-8edd-807d3f973d65@192.168.206.46@tcp t0 exp 0000000000000000 cur 204 last 0 00000020:00000080:2.0:1790710727.543094:0:6697:0:(genops.c:1384:class_connect()) connect: client 0ec73bd1-726e-4dc0-8edd-807d3f973d65, cookie 0xcbad34b281570cf5 00002000:00100000:2.0:1790710727.543104:0:6697:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0ec73bd1-726e-4dc0-8edd-807d3f973d65/ffff9c51f4449000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790710727.543147:0:6697:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1790710727.544255:0:6697:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1790710727.544292:0:6697:0:(import.c:65:import_set_state_nolock()) ffff9c51f947a000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790710727.544647:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158108416 00000100:00100000:3.0:1790710727.544655:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158108416 00000100:00100000:3.0:1790710727.544702:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 0 00000100:00100000:3.0:1790710727.544728:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9574e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:5582:x1877696158108416:12345-192.168.206.46@tcp:33: 00000100:00100000:2.0:1790710727.546308:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9575500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:2355:x1877696158108160:12345-192.168.206.46@tcp:8: Request processed in 3266us (3763us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710727.546320:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 8 00000100:00100000:2.0:1790710727.546351:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 9 00000100:00100000:2.0:1790710727.546364:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9577b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2355:x1877696158108288:12345-192.168.206.46@tcp:8: 00010000:00080000:2.0:1790710727.546392:0:6697:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 0ec73bd1-726e-4dc0-8edd-807d3f973d65@192.168.206.46@tcp t0 exp 0000000000000000 cur 204 last 0 00000020:00000080:2.0:1790710727.546421:0:6697:0:(genops.c:1384:class_connect()) connect: client 0ec73bd1-726e-4dc0-8edd-807d3f973d65, cookie 0xcbad34b281570cfc 00002000:00100000:2.0:1790710727.546432:0:6697:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0ec73bd1-726e-4dc0-8edd-807d3f973d65/ffff9c51f947b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790710727.546453:0:6697:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1790710727.546769:0:6697:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1790710727.548017:0:6697:0:(import.c:65:import_set_state_nolock()) ffff9c51fbac5800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790710727.548092:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9577b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:2355:x1877696158108288:12345-192.168.206.46@tcp:8: Request processed in 1725us (5518us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710727.548103:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 9 00000004:00080000:3.0:1790710727.564179:0:5848:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 19397us 00000004:00200000:1.0:1790710727.584558:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1790710727.584653:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9574e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:5582:x1877696158108416:12345-192.168.206.46@tcp:33: Request processed in 39940us (42603us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710727.584668:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 0 00000100:00100000:0.0:1790710727.799390:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710727.799476:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158108672 00000100:00100000:2.0:1790710727.799487:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158108672 00000100:00100000:2.0:1790710727.799544:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 8 00000100:00100000:2.0:1790710727.799554:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51fef71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:5624:x1877696158108672:12345-192.168.206.46@tcp:101: 00010000:00010000:2.0:1790710727.799573:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790710727.799638:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046200/0xcbad34b281570d03 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b05700034b expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710727.799699:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046c00/0xcbad34b281570d0a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710727.799713:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046c00/0xcbad34b281570d0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710727.799862:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046c00/0xcbad34b281570d0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790710727.799906:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790710727.799916:0:5845:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790710727.799936:0:5845:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046c00/0xcbad34b281570d0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710727.799966:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046200/0xcbad34b281570d03 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700034b expref: 8 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710727.799985:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046c00/0xcbad34b281570d0a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700034b expref: 7 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710727.799994:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c51cca25200) 00010000:00010000:2.0:1790710727.799997:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790710727.800000:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c8046c00, rc 0) 00000100:00100000:2.0:1790710727.800064:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51fef71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+7:5624:x1877696158108672:12345-192.168.206.46@tcp:101: Request processed in 511us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710727.800072:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 8 00000100:00100000:1.0:1790710727.944301:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790710727.944325:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51fef70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1877696177004288:0@lo:13: 00000100:00100000:1.0:1790710727.944401:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710727.944747:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177004288 00000100:00100000:0.0:1790710727.944756:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177004288 00000100:00100000:0.0:1790710727.944811:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790710727.944822:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877696177004288:12345-0@lo:13: 00002000:00000024:0.0:1790710727.944845:0:6700:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790710727.944911:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877696177004288:12345-0@lo:13: Request processed in 91us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710727.944919:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1790710727.945048:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51fef70a80 x1877696177004288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790710743 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790710727.945067:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51fef70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1877696177004288:0@lo:13: 00010000:00010000:0.0:1790710728.199470:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790710728.456400:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1877696177004416:0@lo:13: 00000100:00100000:2.0:1790710728.456470:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710728.457373:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177004416 00000100:00100000:0.0:1790710728.457383:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177004416 00000100:00100000:0.0:1790710728.457444:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790710728.457454:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8e8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877696177004416:12345-0@lo:13: 00002000:00000024:0.0:1790710728.457480:0:6700:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790710728.459417:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8e8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877696177004416:12345-0@lo:13: Request processed in 1957us (2939us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710728.459430:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1790710728.469358:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51f4d65180 x1877696177004416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790710744 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790710728.469386:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1877696177004416:0@lo:13: 00000001:00100000:3.0:1790710729.017151:0:6720:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0ec73bd1-726e-4dc0-8edd-807d3f973d65 00010000:00010000:0.0:1790710729.223594:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790710729.839428:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710729.839502:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158108800 00000100:00100000:3.0:1790710729.839511:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158108800 00000100:00100000:3.0:1790710729.839574:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 9 00000100:00100000:3.0:1790710729.839584:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+7:5676:x1877696158108800:12345-192.168.206.46@tcp:41: 00000004:00000024:3.0:1790710729.839627:0:5846:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1790710729.839688:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+7:5676:x1877696158108800:12345-192.168.206.46@tcp:41: Request processed in 105us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710729.839695:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 9 00000100:00080000:1.0:1790710729.839850:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790710729.849107:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710729.852118:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158108928 00000100:00100000:2.0:1790710729.852159:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158108928 00000100:00100000:2.0:1790710729.852249:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 8 00000100:00100000:2.0:1790710729.852261:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f8ce4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0ec73bd1-726e-4dc0-8edd-807d3f973d65+5:5676:x1877696158108928:12345-192.168.206.46@tcp:13: 00002000:00000024:2.0:1790710729.852299:0:6699:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790710729.852377:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f8ce4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0ec73bd1-726e-4dc0-8edd-807d3f973d65+5:5676:x1877696158108928:12345-192.168.206.46@tcp:13: Request processed in 119us (3279us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710729.852385:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 8 00000100:00080000:1.0:1790710729.852734:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790710729.865992:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710729.866092:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158109056 00000100:00100000:2.0:1790710729.866115:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158109056 00000100:00100000:2.0:1790710729.866241:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 9 00000100:00100000:2.0:1790710729.866252:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51fef73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:5676:x1877696158109056:12345-192.168.206.46@tcp:13: 00002000:00000024:2.0:1790710729.866290:0:6699:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790710729.866354:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51fef73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:5676:x1877696158109056:12345-192.168.206.46@tcp:13: Request processed in 104us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710729.866360:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 9 00000100:00080000:1.0:1790710729.866542:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1790710730.247378:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710731.272274:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1790710731.597436:0:5867:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0ec73bd1-726e-4dc0-8edd-807d3f973d65 00000001:00100000:3.0:1790710731.626473:0:7643:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0ec73bd1-726e-4dc0-8edd-807d3f973d65 00010000:00010000:2.0:1790710732.295292:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790710732.502024:0:8295:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1790710732.555668:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51fef70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1877696177004800:0@lo:400: 00000100:00100000:0.0:1790710732.555733:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710732.555786:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790710732.555792:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51fef72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1877696177004928:0@lo:400: 00000100:00100000:0.0:1790710732.555817:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710732.555872:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177004800 00000100:00100000:0.0:1790710732.555880:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177004800 00000100:00100000:0.0:1790710732.555931:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790710732.555942:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51fef73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877696177004800:12345-0@lo:400: 00000100:00100000:0.0:1790710732.555991:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51fef73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877696177004800:12345-0@lo:400: Request processed in 52us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710732.555998:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790710732.556018:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177004928 00000100:00100000:0.0:1790710732.556022:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177004928 00000100:00100000:0.0:1790710732.556047:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790710732.556054:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51fef72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1877696177004928:12345-0@lo:400: 00000100:00100000:0.0:1790710732.556080:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51fef72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1877696177004928:12345-0@lo:400: Request processed in 28us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710732.556087:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1790710732.556100:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790710732.556105:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1790710732.556157:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51fef72d80 x1877696177004928/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790710748 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790710732.556171:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51fef72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1877696177004928:0@lo:400: 00000100:00100000:0.0:1790710732.556184:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51fef70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1877696177004800:0@lo:400: 00000100:00100000:2.0:1790710732.556258:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51fef71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d27fc27-b651-404a-bd8c-b798806fb18a:3311:1877696177004544:0@lo:400: 00000100:00100000:2.0:1790710732.556301:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710732.556330:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51fef73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1877696177005056:0@lo:400: 00000100:00100000:2.0:1790710732.556367:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710732.556388:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1790710732.556395:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51fef71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1877696177004672:0@lo:400: 00000100:00100000:2.0:1790710732.556415:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710732.556431:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51fef72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177005184:0@lo:400: 00000100:00100000:2.0:1790710732.556449:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710732.556473:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177005056 00000100:00100000:2.0:1790710732.556476:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177005056 00000100:00100000:2.0:1790710732.556498:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177004672 00000100:00100000:2.0:1790710732.556501:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177004672 00000100:00100000:2.0:1790710732.556514:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790710732.556520:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1877696177005056:12345-0@lo:400: 00000100:00100000:2.0:1790710732.556552:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1877696177005056:12345-0@lo:400: Request processed in 32us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710732.556559:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790710732.556579:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790710732.556585:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1877696177004672:12345-0@lo:400: 00000100:00100000:2.0:1790710732.556613:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1877696177004672:12345-0@lo:400: Request processed in 28us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710732.556618:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790710732.556636:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177005184 00000100:00100000:2.0:1790710732.556639:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177005184 00000100:00100000:2.0:1790710732.556660:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790710732.556666:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1877696177005184:12345-0@lo:400: 00000100:00100000:2.0:1790710732.556695:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1877696177005184:12345-0@lo:400: Request processed in 30us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710732.556701:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790710732.556724:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51fef71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1877696177004672:0@lo:400: 00010000:00080000:2.0:1790710732.556733:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51fef72680 x1877696177005184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790710748 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790710732.556742:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51fef72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177005184:0@lo:400: 00000100:00100000:2.0:1790710732.556751:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51fef73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1877696177005056:0@lo:400: 00000100:00100000:0.0:1790710732.556883:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177004544 00000100:00100000:0.0:1790710732.556894:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177004544 00000100:00100000:0.0:1790710732.556928:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1790710732.556935:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c64e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+19:3311:x1877696177004544:12345-0@lo:400: 00000100:00100000:0.0:1790710732.556971:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c64e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+19:3311:x1877696177004544:12345-0@lo:400: Request processed in 37us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710732.556977:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:0.0:1790710732.557002:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790710732.557005:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790710732.557022:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51fef71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d27fc27-b651-404a-bd8c-b798806fb18a:3311:1877696177004544:0@lo:400: 00000100:00100000:3.0:1790710732.781946:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710732.781988:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710732.782022:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710732.782043:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710732.782185:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158109312 00000100:00100000:1.0:1790710732.782194:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158109312 00000100:00100000:1.0:1790710732.782255:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 25 00000100:00100000:1.0:1790710732.782276:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f8ce5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:2358:x1877696158109312:12345-192.168.206.46@tcp:400: 00000100:00100000:1.0:1790710732.782350:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f8ce5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:2358:x1877696158109312:12345-192.168.206.46@tcp:400: Request processed in 85us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710732.782357:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 25 00000100:00100000:0.0:1790710732.783219:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158109184 00000100:00100000:0.0:1790710732.783226:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158109184 00000100:00100000:0.0:1790710732.783264:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 130 00000100:00100000:0.0:1790710732.783273:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c64e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b75d7a5-152f-4db9-bf19-5fe279a322e3+10:2359:x1877696158109184:12345-192.168.206.46@tcp:400: 00000100:00100000:0.0:1790710732.783318:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c64e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b75d7a5-152f-4db9-bf19-5fe279a322e3+10:2359:x1877696158109184:12345-192.168.206.46@tcp:400: Request processed in 47us (1382us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710732.783326:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 130 00000100:00080000:3.0:1790710732.783340:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790710732.783352:0:6696:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158109440 00000100:00100000:0.0:1790710732.783356:0:6696:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158109440 00000100:00100000:0.0:1790710732.783392:0:6696:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158109568 00000100:00100000:0.0:1790710732.783395:0:6696:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158109568 00000100:00100000:0.0:1790710732.783412:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 7 00000100:00100000:0.0:1790710732.783418:0:6696:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f8ce4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+5:2359:x1877696158109440:12345-192.168.206.46@tcp:400: 00000100:00080000:3.0:1790710732.783431:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790710732.783443:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790710732.783445:0:6696:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f8ce4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+5:2359:x1877696158109440:12345-192.168.206.46@tcp:400: Request processed in 27us (1423us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710732.783451:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 7 00000100:00100000:0.0:1790710732.783462:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 8 00000100:00100000:0.0:1790710732.783468:0:6696:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f8ce6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+5:2358:x1877696158109568:12345-192.168.206.46@tcp:400: 00000100:00100000:0.0:1790710732.783501:0:6696:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f8ce6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+5:2358:x1877696158109568:12345-192.168.206.46@tcp:400: Request processed in 33us (1456us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710732.783508:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 8 00000100:00100000:1.0:1790710733.063468:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790710733.063495:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51fef71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1877696177005312:0@lo:13: 00000100:00100000:1.0:1790710733.063564:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710733.065517:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177005312 00000100:00100000:3.0:1790710733.065532:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177005312 00000100:00100000:3.0:1790710733.065602:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790710733.065612:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877696177005312:12345-0@lo:13: 00002000:00000024:3.0:1790710733.065649:0:6699:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790710733.065902:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877696177005312:12345-0@lo:13: Request processed in 291us (2337us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710733.065910:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1790710733.066008:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51fef71180 x1877696177005312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790710749 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790710733.066028:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51fef71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1877696177005312:0@lo:13: 00010000:00010000:2.0:1790710733.323240:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790710733.575318:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1877696177005440:0@lo:13: 00000100:00100000:0.0:1790710733.575405:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710733.575511:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177005440 00000100:00100000:1.0:1790710733.575520:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177005440 00000100:00100000:1.0:1790710733.575575:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790710733.575586:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51fef70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877696177005440:12345-0@lo:13: 00002000:00000024:1.0:1790710733.575619:0:6700:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790710733.575668:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51fef70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877696177005440:12345-0@lo:13: Request processed in 84us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710733.575675:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1790710733.575728:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51f4d64380 x1877696177005440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790710749 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790710733.575745:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1877696177005440:0@lo:13: 00010000:00010000:2.0:1790710734.343828:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710735.367422:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1790710736.317916:0:8444:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcb3d82670 20000000:00000080:2.0:1790710736.317933:0:8444:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c51ff9ec000 uarg=0000000000000000 20000000:01000000:2.0:1790710736.317968:0:8444:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1790710736.317971:0:8444:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1790710736.317973:0:8444:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1790710736.317978:0:8444:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1790710736.317982:0:8444:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1790710736.317999:0:8444:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1790710736.318001:0:8444:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1790710736.318629:0:8444:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1790710736.318633:0:8444:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1790710736.320055:0:8445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:2.0:1790710736.320540:0:8444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:2.0:1790710736.320598:0:8444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:2.0:1790710736.320632:0:8444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:2.0:1790710736.320643:0:8444:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1790710736.320645:0:8444:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1790710736.327468:0:8446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1790710736.327910:0:8444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1790710736.327960:0:8444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:2.0:1790710736.327995:0:8444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:2.0:1790710736.328006:0:8444:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1790710736.328008:0:8444:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1790710736.328902:0:8447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:2.0:1790710736.329269:0:8444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:2.0:1790710736.329305:0:8444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:2.0:1790710736.329344:0:8444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:2.0:1790710736.329355:0:8444:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1790710736.329358:0:8444:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1790710736.330124:0:8448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:2.0:1790710736.333352:0:8444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:2.0:1790710736.333403:0:8444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:2.0:1790710736.333440:0:8444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 10000000:01000000:2.0:1790710736.333456:0:8444:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1790710736.333474:0:8444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c51c8047e00/0xcbad34b281570d11 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710736.333492:0:8444:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c51c13fd000/0xcbad34b281570c0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281570c07 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710736.333500:0:8444:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c51c1644e00/0xcbad34b281570c38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281570c31 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710736.333506:0:8444:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c51c1645200/0xcbad34b281570c62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281570c5b expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710736.333520:0:8444:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c51c1645a00/0xcbad34b281570c70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281570c69 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710736.333527:0:8444:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c51c1645800/0xcbad34b281570c7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281570c77 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710736.333534:0:8444:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c51c1645400/0xcbad34b281570c9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281570c93 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710736.333540:0:8444:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c51c8047200/0xcbad34b281570cc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281570cbd expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710736.333549:0:8444:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c51c6481000/0xcbad34b281570cd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570002e9 expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710736.333556:0:8444:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c51c6480800/0xcbad34b281570cd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570002f0 expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710736.333563:0:8444:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c51c8047e00/0xcbad34b281570d11 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710736.333600:0:8444:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c51c6480800/0xcbad34b281570cd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.206.46@tcp remote: 0x566877b0570002f0 expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710736.333617:0:8444:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c51c6480800/0xcbad34b281570cd9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570002f0 expref: 9 pid: 5840 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710736.333630:0:8444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d5c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8444:1877696177005568:192.168.206.46@tcp:104: 00010000:00010000:2.0:1790710736.333937:0:8444:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c51c6481000/0xcbad34b281570cd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.206.46@tcp remote: 0x566877b0570002e9 expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710736.333955:0:8444:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c51c6481000/0xcbad34b281570cd2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570002e9 expref: 9 pid: 5840 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710736.333964:0:8444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d5ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8444:1877696177005696:192.168.206.46@tcp:104: 00010000:00010000:2.0:1790710736.333999:0:8444:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c51c8047200/0xcbad34b281570cc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbad34b281570cbd expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710736.334008:0:8444:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c51c8047200/0xcbad34b281570cc4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbad34b281570cbd expref: 18 pid: 5840 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710736.334017:0:8444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d5f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8444:1877696177005824:0@lo:104: 00000100:00100000:2.0:1790710736.334054:0:8444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790710736.334090:0:8444:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c51c1645400/0xcbad34b281570c9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbad34b281570c93 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710736.334098:0:8444:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c51c1645400/0xcbad34b281570c9a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbad34b281570c93 expref: 18 pid: 5838 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710736.334106:0:8444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d5f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8444:1877696177005952:0@lo:104: 00000100:00100000:2.0:1790710736.334187:0:8444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790710736.334297:0:8444:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c51c1645800/0xcbad34b281570c7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbad34b281570c77 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710736.334306:0:8444:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c51c1645800/0xcbad34b281570c7e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbad34b281570c77 expref: 18 pid: 5840 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710736.334315:0:8444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d5e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8444:1877696177006080:0@lo:104: 00010000:00010000:2.0:1790710736.334339:0:8444:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c51c1645a00/0xcbad34b281570c70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbad34b281570c69 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710736.334353:0:8444:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c51c1645a00/0xcbad34b281570c70 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbad34b281570c69 expref: 18 pid: 5837 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710736.334362:0:8444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d5ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8444:1877696177006208:0@lo:104: 00010000:00010000:2.0:1790710736.334389:0:8444:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c51c1645200/0xcbad34b281570c62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbad34b281570c5b expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710736.334397:0:8444:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c51c1645200/0xcbad34b281570c62 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbad34b281570c5b expref: 18 pid: 5840 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710736.334404:0:8444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d5c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8444:1877696177006336:0@lo:104: 00010000:00010000:2.0:1790710736.334426:0:8444:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c51c1644e00/0xcbad34b281570c38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbad34b281570c31 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710736.334434:0:8444:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c51c1644e00/0xcbad34b281570c38 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbad34b281570c31 expref: 18 pid: 5837 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710736.334442:0:8444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d5dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8444:1877696177006464:0@lo:104: 00010000:00010000:2.0:1790710736.334465:0:8444:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c51c13fd000/0xcbad34b281570c0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbad34b281570c07 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710736.334473:0:8444:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c51c13fd000/0xcbad34b281570c0e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbad34b281570c07 expref: 18 pid: 5840 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710736.334480:0:8444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d5c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8444:1877696177006592:0@lo:104: 00000100:00100000:2.0:1790710736.334497:0:8444:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f9f1c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790710736.336173:0:5828:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1790710736.336204:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710736.336217:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710736.336225:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710736.336232:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710736.336239:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710736.336246:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177005824 00000100:00100000:0.0:1790710736.336252:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177005824 00000100:00100000:0.0:1790710736.336293:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177005952 00000100:00100000:0.0:1790710736.336296:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177005952 00000100:00100000:0.0:1790710736.336309:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177006080 00000100:00100000:0.0:1790710736.336311:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177006080 00000100:00100000:0.0:1790710736.336319:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177006208 00000100:00100000:0.0:1790710736.336321:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177006208 00000100:00100000:0.0:1790710736.336328:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177006336 00000100:00100000:0.0:1790710736.336331:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177006336 00000100:00100000:0.0:1790710736.336339:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177006464 00000100:00100000:1.0:1790710736.336341:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177006592 00000100:00100000:0.0:1790710736.336341:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177006464 00000100:00100000:1.0:1790710736.336344:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177006592 00000100:00100000:0.0:1790710736.336351:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790710736.336359:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d5e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5d27fc27-b651-404a-bd8c-b798806fb18a+9:8444:x1877696177005824:12345-0@lo:104: 00010000:00010000:0.0:1790710736.336375:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.146@tcp lock: ffff9c51c0031a00/0xcbad34b281570cbd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbad34b281570cc4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710736.336691:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790710736.336697:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d5e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5d27fc27-b651-404a-bd8c-b798806fb18a+9:8444:x1877696177005824:12345-0@lo:104: Request processed in 339us (2643us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710736.336705:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790710736.336723:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790710736.336730:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4fc4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5d27fc27-b651-404a-bd8c-b798806fb18a+8:8444:x1877696177005952:12345-0@lo:104: 00010000:00010000:0.0:1790710736.336739:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.146@tcp lock: ffff9c51c8047a00/0xcbad34b281570c93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbad34b281570c9a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710736.336774:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1790710736.336779:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4fc4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5d27fc27-b651-404a-bd8c-b798806fb18a+8:8444:x1877696177005952:12345-0@lo:104: Request processed in 52us (2593us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710736.336784:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790710736.336817:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790710736.336840:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51fef72d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5d27fc27-b651-404a-bd8c-b798806fb18a+7:8444:x1877696177006080:12345-0@lo:104: 00010000:00010000:0.0:1790710736.336847:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.146@tcp lock: ffff9c51c0030800/0xcbad34b281570c77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbad34b281570c7e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710736.336877:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1790710736.336881:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51fef72d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5d27fc27-b651-404a-bd8c-b798806fb18a+7:8444:x1877696177006080:12345-0@lo:104: Request processed in 59us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710736.336887:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790710736.336897:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790710736.336903:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51fef72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5d27fc27-b651-404a-bd8c-b798806fb18a+6:8444:x1877696177006208:12345-0@lo:104: 00010000:00010000:0.0:1790710736.336922:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.146@tcp lock: ffff9c51c0030c00/0xcbad34b281570c69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbad34b281570c70 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710736.336957:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1790710736.336962:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51fef72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5d27fc27-b651-404a-bd8c-b798806fb18a+6:8444:x1877696177006208:12345-0@lo:104: Request processed in 60us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710736.336967:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790710736.336980:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790710736.336987:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51fef70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5d27fc27-b651-404a-bd8c-b798806fb18a+5:8444:x1877696177006336:12345-0@lo:104: 00010000:00010000:0.0:1790710736.336995:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.146@tcp lock: ffff9c51c13fd200/0xcbad34b281570c5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbad34b281570c62 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710736.337161:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1790710736.337167:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.146@tcp lock: ffff9c51c0031a00/0xcbad34b281570cbd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbad34b281570cc4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710736.337174:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c0031a00 already unused, calling callback (ffffffffc1cdfc20) 10000000:00010000:1.0:1790710736.337178:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.146@tcp lock: ffff9c51c0031a00/0xcbad34b281570cbd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbad34b281570cc4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710736.337197:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.146@tcp lock: ffff9c51c0031a00/0xcbad34b281570cbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbad34b281570cc4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790710736.337204:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.146@tcp lock: ffff9c51c0031a00/0xcbad34b281570cbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbad34b281570cc4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790710736.337210:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790710736.337240:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.146@tcp lock: ffff9c51c0031a00/0xcbad34b281570cbd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281570cc4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710736.337246:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790710736.337267:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.146@tcp lock: ffff9c51c0031a00/0xcbad34b281570cbd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281570cc4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710736.337273:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.146@tcp lock: ffff9c51c0031a00/0xcbad34b281570cbd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281570cc4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710736.337286:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1790710736.337289:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.146@tcp lock: ffff9c51c8047a00/0xcbad34b281570c93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbad34b281570c9a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710736.337294:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c8047a00 already unused, calling callback (ffffffffc1cdfc20) 10000000:00010000:1.0:1790710736.337297:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.146@tcp lock: ffff9c51c8047a00/0xcbad34b281570c93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbad34b281570c9a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710736.337303:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.146@tcp lock: ffff9c51c8047a00/0xcbad34b281570c93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbad34b281570c9a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790710736.337309:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.146@tcp lock: ffff9c51c8047a00/0xcbad34b281570c93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbad34b281570c9a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790710736.337321:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790710736.337333:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.146@tcp lock: ffff9c51c8047a00/0xcbad34b281570c93 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281570c9a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710736.337338:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790710736.337342:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.146@tcp lock: ffff9c51c8047a00/0xcbad34b281570c93 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281570c9a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710736.337347:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.146@tcp lock: ffff9c51c8047a00/0xcbad34b281570c93 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281570c9a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710736.337354:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790710736.337356:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.146@tcp lock: ffff9c51c0030800/0xcbad34b281570c77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbad34b281570c7e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710736.337360:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c0030800 already unused, calling callback (ffffffffc1cdfc20) 10000000:00010000:1.0:1790710736.337363:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.146@tcp lock: ffff9c51c0030800/0xcbad34b281570c77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbad34b281570c7e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710736.337368:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.146@tcp lock: ffff9c51c0030800/0xcbad34b281570c77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbad34b281570c7e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790710736.337373:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.146@tcp lock: ffff9c51c0030800/0xcbad34b281570c77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbad34b281570c7e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790710736.337377:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790710736.337384:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.146@tcp lock: ffff9c51c0030800/0xcbad34b281570c77 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281570c7e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710736.337389:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790710736.337407:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.146@tcp lock: ffff9c51c0030800/0xcbad34b281570c77 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281570c7e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710736.337412:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.146@tcp lock: ffff9c51c0030800/0xcbad34b281570c77 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281570c7e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710736.337550:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1790710736.337556:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51fef70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5d27fc27-b651-404a-bd8c-b798806fb18a+5:8444:x1877696177006336:12345-0@lo:104: Request processed in 570us (1329us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710736.337570:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790710736.337583:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790710736.337589:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51fef71c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5d27fc27-b651-404a-bd8c-b798806fb18a+4:8444:x1877696177006464:12345-0@lo:104: 00010000:00010000:0.0:1790710736.337596:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.146@tcp lock: ffff9c51c0030000/0xcbad34b281570c31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbad34b281570c38 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710736.337627:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1790710736.337632:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51fef71c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5d27fc27-b651-404a-bd8c-b798806fb18a+4:8444:x1877696177006464:12345-0@lo:104: Request processed in 44us (1399us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710736.337637:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790710736.337648:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790710736.337654:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51fef70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5d27fc27-b651-404a-bd8c-b798806fb18a+3:8444:x1877696177006592:12345-0@lo:104: 00010000:00010000:0.0:1790710736.337660:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.146@tcp lock: ffff9c51c8046e00/0xcbad34b281570c07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbad34b281570c0e expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710736.337693:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1790710736.337697:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51fef70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5d27fc27-b651-404a-bd8c-b798806fb18a+3:8444:x1877696177006592:12345-0@lo:104: Request processed in 45us (1457us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710736.337703:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790710736.337728:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d27fc27-b651-404a-bd8c-b798806fb18a:3311:1877696177006720:0@lo:103: 00000100:00100000:0.0:1790710736.337760:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710736.337795:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790710736.337801:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d27fc27-b651-404a-bd8c-b798806fb18a:3311:1877696177006848:0@lo:103: 00000100:00100000:0.0:1790710736.337822:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710736.337861:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177006720 00000100:00100000:0.0:1790710736.337867:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177006720 00010000:00010000:0.0:1790710736.337889:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c51c8047200/0xcbad34b281570cc4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbad34b281570cbd expref: 19 pid: 5840 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710736.337908:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177006848 00000100:00100000:0.0:1790710736.337910:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177006848 00010000:00010000:0.0:1790710736.337919:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c51c1645400/0xcbad34b281570c9a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbad34b281570c93 expref: 20 pid: 5838 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710736.337930:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790710736.337935:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51fef71f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d27fc27-b651-404a-bd8c-b798806fb18a+20:3311:x1877696177006720:12345-0@lo:103: 00010000:00010000:0.0:1790710736.337945:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790710736.337949:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c51c8047200/0xcbad34b281570cc4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbad34b281570cbd expref: 20 pid: 5840 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710736.337958:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c51c8047200/0xcbad34b281570cc4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbad34b281570cbd expref: 20 pid: 5840 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710736.337998:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790710736.338180:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51fef71f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d27fc27-b651-404a-bd8c-b798806fb18a+20:3311:x1877696177006720:12345-0@lo:103: Request processed in 244us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710736.338187:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790710736.338202:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790710736.338209:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51fef70e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d27fc27-b651-404a-bd8c-b798806fb18a+19:3311:x1877696177006848:12345-0@lo:103: 00010000:00010000:0.0:1790710736.338217:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790710736.338221:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c51c1645400/0xcbad34b281570c9a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbad34b281570c93 expref: 19 pid: 5838 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710736.338229:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c51c1645400/0xcbad34b281570c9a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbad34b281570c93 expref: 19 pid: 5838 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710736.338237:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790710736.338257:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51fef70e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d27fc27-b651-404a-bd8c-b798806fb18a+19:3311:x1877696177006848:12345-0@lo:103: Request processed in 50us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710736.338263:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790710736.338300:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d27fc27-b651-404a-bd8c-b798806fb18a:3311:1877696177006848:0@lo:103: 00000100:00100000:0.0:1790710736.338310:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d27fc27-b651-404a-bd8c-b798806fb18a:3311:1877696177006720:0@lo:103: 00000100:00100000:0.0:1790710736.338350:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d27fc27-b651-404a-bd8c-b798806fb18a:3309:1877696177006976:0@lo:103: 00000100:00100000:0.0:1790710736.338372:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710736.338398:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177006976 00000100:00100000:0.0:1790710736.338402:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177006976 00010000:00010000:0.0:1790710736.338417:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c51c1645800/0xcbad34b281570c7e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbad34b281570c77 expref: 19 pid: 5840 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710736.338433:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790710736.338446:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51fef73b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d27fc27-b651-404a-bd8c-b798806fb18a+19:3309:x1877696177006976:12345-0@lo:103: 00010000:00010000:0.0:1790710736.338454:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790710736.338459:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c51c1645800/0xcbad34b281570c7e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbad34b281570c77 expref: 19 pid: 5840 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710736.338466:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c51c1645800/0xcbad34b281570c7e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbad34b281570c77 expref: 19 pid: 5840 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710736.338474:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790710736.338498:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51fef73b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d27fc27-b651-404a-bd8c-b798806fb18a+19:3309:x1877696177006976:12345-0@lo:103: Request processed in 54us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710736.338503:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790710736.338523:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d27fc27-b651-404a-bd8c-b798806fb18a:3309:1877696177006976:0@lo:103: 00010000:00010000:1.0:1790710736.338595:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1790710736.338599:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.146@tcp lock: ffff9c51c0030c00/0xcbad34b281570c69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbad34b281570c70 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710736.338606:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c0030c00 already unused, calling callback (ffffffffc1cdfc20) 10000000:00010000:1.0:1790710736.338609:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.146@tcp lock: ffff9c51c0030c00/0xcbad34b281570c69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbad34b281570c70 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710736.338617:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.146@tcp lock: ffff9c51c0030c00/0xcbad34b281570c69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbad34b281570c70 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790710736.338624:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.146@tcp lock: ffff9c51c0030c00/0xcbad34b281570c69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbad34b281570c70 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790710736.338629:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790710736.338649:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.146@tcp lock: ffff9c51c0030c00/0xcbad34b281570c69 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281570c70 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710736.338653:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790710736.338673:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.146@tcp lock: ffff9c51c0030c00/0xcbad34b281570c69 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281570c70 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710736.338679:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.146@tcp lock: ffff9c51c0030c00/0xcbad34b281570c69 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281570c70 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710736.338688:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1790710736.338697:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.146@tcp lock: ffff9c51c13fd200/0xcbad34b281570c5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbad34b281570c62 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710736.338702:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c13fd200 already unused, calling callback (ffffffffc1cdfc20) 10000000:00010000:1.0:1790710736.338704:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.146@tcp lock: ffff9c51c13fd200/0xcbad34b281570c5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbad34b281570c62 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710736.338710:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.146@tcp lock: ffff9c51c13fd200/0xcbad34b281570c5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbad34b281570c62 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790710736.338716:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.146@tcp lock: ffff9c51c13fd200/0xcbad34b281570c5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbad34b281570c62 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790710736.338720:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790710736.338732:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.146@tcp lock: ffff9c51c13fd200/0xcbad34b281570c5b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281570c62 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710736.338736:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790710736.338743:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.146@tcp lock: ffff9c51c13fd200/0xcbad34b281570c5b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281570c62 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710736.338749:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.146@tcp lock: ffff9c51c13fd200/0xcbad34b281570c5b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281570c62 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710736.338758:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790710736.338760:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.146@tcp lock: ffff9c51c0030000/0xcbad34b281570c31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbad34b281570c38 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710736.338765:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c0030000 already unused, calling callback (ffffffffc1cdfc20) 10000000:00010000:1.0:1790710736.338767:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.146@tcp lock: ffff9c51c0030000/0xcbad34b281570c31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbad34b281570c38 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710736.338782:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.146@tcp lock: ffff9c51c0030000/0xcbad34b281570c31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbad34b281570c38 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790710736.338787:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.146@tcp lock: ffff9c51c0030000/0xcbad34b281570c31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbad34b281570c38 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790710736.338792:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790710736.338804:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.146@tcp lock: ffff9c51c0030000/0xcbad34b281570c31 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281570c38 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710736.338810:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790710736.338814:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.146@tcp lock: ffff9c51c0030000/0xcbad34b281570c31 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281570c38 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710736.338820:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.146@tcp lock: ffff9c51c0030000/0xcbad34b281570c31 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281570c38 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710736.338840:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790710736.338842:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.146@tcp lock: ffff9c51c8046e00/0xcbad34b281570c07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbad34b281570c0e expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710736.338847:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c8046e00 already unused, calling callback (ffffffffc1cdfc20) 10000000:00010000:1.0:1790710736.338850:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.146@tcp lock: ffff9c51c8046e00/0xcbad34b281570c07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbad34b281570c0e expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710736.338856:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.146@tcp lock: ffff9c51c8046e00/0xcbad34b281570c07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbad34b281570c0e expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790710736.338861:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.146@tcp lock: ffff9c51c8046e00/0xcbad34b281570c07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbad34b281570c0e expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790710736.338873:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790710736.338884:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.146@tcp lock: ffff9c51c8046e00/0xcbad34b281570c07 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281570c0e expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710736.338889:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790710736.338893:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.146@tcp lock: ffff9c51c8046e00/0xcbad34b281570c07 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281570c0e expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710736.338898:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.146@tcp lock: ffff9c51c8046e00/0xcbad34b281570c07 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281570c0e expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710736.338909:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790710736.338911:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790710736.338912:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790710736.339003:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790710736.339246:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d27fc27-b651-404a-bd8c-b798806fb18a:3310:1877696177007104:0@lo:103: 00000100:00100000:0.0:1790710736.339279:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710736.339318:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790710736.339324:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d27fc27-b651-404a-bd8c-b798806fb18a:3310:1877696177007488:0@lo:103: 00000100:00100000:0.0:1790710736.339344:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710736.339368:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d27fc27-b651-404a-bd8c-b798806fb18a:3312:1877696177007360:0@lo:103: 00000100:00100000:0.0:1790710736.339388:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710736.339403:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790710736.339408:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d27fc27-b651-404a-bd8c-b798806fb18a:3312:1877696177007232:0@lo:103: 00000100:00100000:0.0:1790710736.339443:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710736.339462:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177007104 00000100:00100000:0.0:1790710736.339467:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177007104 00010000:00010000:0.0:1790710736.339485:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c51c1645a00/0xcbad34b281570c70 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbad34b281570c69 expref: 19 pid: 5837 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710736.339511:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177007488 00000100:00100000:0.0:1790710736.339515:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177007488 00010000:00010000:0.0:1790710736.339527:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c51c13fd000/0xcbad34b281570c0e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbad34b281570c07 expref: 20 pid: 5840 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710736.339536:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177007360 00000100:00100000:0.0:1790710736.339539:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177007360 00010000:00010000:0.0:1790710736.339549:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c51c1644e00/0xcbad34b281570c38 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbad34b281570c31 expref: 21 pid: 5837 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710736.339563:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177007232 00000100:00100000:0.0:1790710736.339565:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177007232 00000100:00100000:3.0:1790710736.339570:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00010000:00010000:0.0:1790710736.339579:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c51c1645200/0xcbad34b281570c62 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbad34b281570c5b expref: 22 pid: 5840 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710736.339584:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51fef71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d27fc27-b651-404a-bd8c-b798806fb18a+22:3310:x1877696177007104:12345-0@lo:103: 00000100:00100000:0.0:1790710736.339596:0:5829:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:3.0:1790710736.339598:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1790710736.339606:0:5829:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:3.0:1790710736.339607:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c51c1645a00/0xcbad34b281570c70 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbad34b281570c69 expref: 22 pid: 5837 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710736.339620:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c51c1645a00/0xcbad34b281570c70 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbad34b281570c69 expref: 22 pid: 5837 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710736.339635:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790710736.339674:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51fef71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d27fc27-b651-404a-bd8c-b798806fb18a+22:3310:x1877696177007104:12345-0@lo:103: Request processed in 96us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710736.339680:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790710736.339699:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790710736.339707:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51fef73480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d27fc27-b651-404a-bd8c-b798806fb18a+21:3310:x1877696177007488:12345-0@lo:103: 00010000:00010000:3.0:1790710736.339715:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790710736.339721:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c51c13fd000/0xcbad34b281570c0e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbad34b281570c07 expref: 21 pid: 5840 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710736.339721:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d27fc27-b651-404a-bd8c-b798806fb18a:3310:1877696177007104:0@lo:103: 00010000:00010000:3.0:1790710736.339746:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c51c13fd000/0xcbad34b281570c0e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbad34b281570c07 expref: 21 pid: 5840 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710736.339758:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790710736.339763:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790710736.339789:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51fef73480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d27fc27-b651-404a-bd8c-b798806fb18a+21:3310:x1877696177007488:12345-0@lo:103: Request processed in 82us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710736.339790:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51fef72680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d27fc27-b651-404a-bd8c-b798806fb18a+21:3312:x1877696177007360:12345-0@lo:103: 00000100:00100000:3.0:1790710736.339803:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:0.0:1790710736.339806:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790710736.339812:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c51c1644e00/0xcbad34b281570c38 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbad34b281570c31 expref: 20 pid: 5837 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710736.339815:0:5831:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:0.0:1790710736.339836:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c51c1644e00/0xcbad34b281570c38 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbad34b281570c31 expref: 20 pid: 5837 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710736.339846:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1790710736.339847:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790710736.339855:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c7cde050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d27fc27-b651-404a-bd8c-b798806fb18a+20:3312:x1877696177007232:12345-0@lo:103: 00010000:00010000:3.0:1790710736.339865:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790710736.339878:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c51c1645200/0xcbad34b281570c62 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbad34b281570c5b expref: 20 pid: 5840 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710736.339880:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51fef72680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d27fc27-b651-404a-bd8c-b798806fb18a+20:3312:x1877696177007360:12345-0@lo:103: Request processed in 109us (490us total) trans 0 rc 0/0 00010000:00010000:3.0:1790710736.339889:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c51c1645200/0xcbad34b281570c62 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbad34b281570c5b expref: 20 pid: 5840 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710736.339899:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:3.0:1790710736.339904:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790710736.339932:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c7cde050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d27fc27-b651-404a-bd8c-b798806fb18a+19:3312:x1877696177007232:12345-0@lo:103: Request processed in 80us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710736.339940:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790710736.339949:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d27fc27-b651-404a-bd8c-b798806fb18a:3312:1877696177007232:0@lo:103: 00000100:00100000:3.0:1790710736.339994:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d27fc27-b651-404a-bd8c-b798806fb18a:3310:1877696177007488:0@lo:103: 00000100:00100000:0.0:1790710736.340307:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d27fc27-b651-404a-bd8c-b798806fb18a:3312:1877696177007360:0@lo:103: 00010000:00010000:2.0:1790710736.341914:0:8444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c51c8047200/0xcbad34b281570cc4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbad34b281570cbd expref: 18 pid: 5840 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710736.341948:0:8444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d5f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8444:1877696177005824:0@lo:104: 00010000:00010000:2.0:1790710736.341964:0:8444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c51c1645400/0xcbad34b281570c9a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbad34b281570c93 expref: 17 pid: 5838 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710736.341973:0:8444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d5f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8444:1877696177005952:0@lo:104: 00010000:00010000:2.0:1790710736.341982:0:8444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c51c1645800/0xcbad34b281570c7e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbad34b281570c77 expref: 16 pid: 5840 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710736.341989:0:8444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d5e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8444:1877696177006080:0@lo:104: 00010000:00010000:2.0:1790710736.341997:0:8444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c51c1645a00/0xcbad34b281570c70 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbad34b281570c69 expref: 15 pid: 5837 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710736.342005:0:8444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d5ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8444:1877696177006208:0@lo:104: 00010000:00010000:2.0:1790710736.342013:0:8444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c51c1645200/0xcbad34b281570c62 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbad34b281570c5b expref: 14 pid: 5840 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710736.342020:0:8444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d5c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8444:1877696177006336:0@lo:104: 00010000:00010000:2.0:1790710736.342028:0:8444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c51c1644e00/0xcbad34b281570c38 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbad34b281570c31 expref: 13 pid: 5837 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710736.342036:0:8444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d5dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8444:1877696177006464:0@lo:104: 00010000:00010000:2.0:1790710736.342044:0:8444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c51c13fd000/0xcbad34b281570c0e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbad34b281570c07 expref: 12 pid: 5840 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710736.342052:0:8444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d5c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8444:1877696177006592:0@lo:104: 00000100:00100000:1.0:1790710736.346339:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710736.346373:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710736.346479:0:8444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d5c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8444:1877696177005568:192.168.206.46@tcp:104: 00000100:00100000:3.0:1790710736.346492:0:8444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d5ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8444:1877696177005696:192.168.206.46@tcp:104: 00010000:00010000:3.0:1790710736.346534:0:8444:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c51c8047e00/0xcbad34b281570d11 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710736.347223:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158109696 00000100:00100000:0.0:1790710736.347232:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158109696 00010000:00010000:0.0:1790710736.347269:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c51c6480800/0xcbad34b281570cd9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570002f0 expref: 10 pid: 5840 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710736.347305:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158109824 00000100:00100000:0.0:1790710736.347309:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158109824 00010000:00010000:0.0:1790710736.347319:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c51c6481000/0xcbad34b281570cd2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570002e9 expref: 11 pid: 5840 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710736.347351:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 19 00000100:00100000:0.0:1790710736.347360:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d64000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b75d7a5-152f-4db9-bf19-5fe279a322e3+11:2359:x1877696158109696:12345-192.168.206.46@tcp:103: 00010000:00010000:0.0:1790710736.347376:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790710736.347383:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c51c6480800/0xcbad34b281570cd9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570002f0 expref: 11 pid: 5840 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710736.347391:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 20 00010000:00010000:0.0:1790710736.347397:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c51c6480800/0xcbad34b281570cd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570002f0 expref: 11 pid: 5840 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710736.347406:0:8449:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d66300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b75d7a5-152f-4db9-bf19-5fe279a322e3+11:2359:x1877696158109824:12345-192.168.206.46@tcp:103: 00010000:00010000:3.0:1790710736.347418:0:8449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790710736.347424:0:8449:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c51c6481000/0xcbad34b281570cd2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570002e9 expref: 11 pid: 5840 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710736.347430:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c51c6480800/0xcbad34b281570cd9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570002f0 expref: 11 pid: 5840 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710736.347439:0:8449:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c51c6481000/0xcbad34b281570cd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570002e9 expref: 11 pid: 5840 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710736.348196:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790710736.348252:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d64000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b75d7a5-152f-4db9-bf19-5fe279a322e3+10:2359:x1877696158109696:12345-192.168.206.46@tcp:103: Request processed in 892us (1920us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710736.348273:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 19 00010000:00010000:3.0:1790710736.351937:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c51c6481000/0xcbad34b281570cd2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570002e9 expref: 9 pid: 5840 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710736.351959:0:8449:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c51c8047e00/0xcbad34b281570d11 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710736.351968:0:8449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c51c8047e00/0xcbad34b281570d11 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710736.351991:0:8449:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c51c8047e00/0xcbad34b281570d11 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710736.351998:0:8449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c51c8047e00/0xcbad34b281570d11 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710736.352004:0:8449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c51c8047e00/0xcbad34b281570d11 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710736.352010:0:8449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c51c8047e00/0xcbad34b281570d11 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710736.352032:0:8449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c8047e00 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:3.0:1790710736.352037:0:8449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c51c8047e00/0xcbad34b281570d11 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710736.352045:0:8449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c51c8047e00/0xcbad34b281570d11 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710736.352070:0:8449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c51c8047e00/0xcbad34b281570d11 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710736.352081:0:8449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790710736.352168:0:8449:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d66300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b75d7a5-152f-4db9-bf19-5fe279a322e3+8:2359:x1877696158109824:12345-192.168.206.46@tcp:103: Request processed in 4765us (5792us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710736.352178:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 20 00010000:00010000:2.0:1790710736.352407:0:8444:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c51c8047e00/0xcbad34b281570d11 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710736.352425:0:8444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c51c8047e00/0xcbad34b281570d11 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710736.352432:0:8444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c51c8047e00/0xcbad34b281570d11 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710736.391246:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790710737.423396:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790710737.672546:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d27fc27-b651-404a-bd8c-b798806fb18a:3310:1877696177007616:0@lo:400: 00000100:00100000:3.0:1790710737.672614:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710737.673031:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177007616 00000100:00100000:0.0:1790710737.673040:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177007616 00000100:00100000:0.0:1790710737.673102:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1790710737.673113:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c64e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+12:3310:x1877696177007616:12345-0@lo:400: 00000100:00100000:1.0:1790710737.673499:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1877696177008000:0@lo:400: 00000100:00100000:1.0:1790710737.673551:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710737.673610:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1877696177007872:0@lo:400: 00000100:00100000:1.0:1790710737.673637:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710737.673657:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790710737.673662:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1877696177007744:0@lo:400: 00000100:00100000:1.0:1790710737.673702:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710737.673740:0:6696:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177008000 00000100:00100000:1.0:1790710737.673745:0:6696:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177008000 00000100:00100000:1.0:1790710737.673781:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790710737.673788:0:6696:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1877696177008000:12345-0@lo:400: 00000100:00100000:1.0:1790710737.673854:0:6696:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1877696177008000:12345-0@lo:400: Request processed in 67us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710737.673862:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1790710737.673883:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790710737.673912:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51f4d5d500 x1877696177008000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790710753 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790710737.673926:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1877696177008000:0@lo:400: 00000100:00100000:1.0:1790710737.673966:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177007872 00000100:00100000:1.0:1790710737.673970:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177007872 00000100:00100000:1.0:1790710737.673994:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177007744 00000100:00100000:1.0:1790710737.673996:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177007744 00000100:00100000:1.0:1790710737.674013:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790710737.674020:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1877696177007872:12345-0@lo:400: 00000100:00100000:1.0:1790710737.674053:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1877696177007872:12345-0@lo:400: Request processed in 34us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710737.674059:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790710737.674070:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790710737.674075:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1877696177007744:12345-0@lo:400: 00000100:00100000:1.0:1790710737.674102:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1877696177007744:12345-0@lo:400: Request processed in 27us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710737.674107:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:1.0:1790710737.674162:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790710737.674183:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1877696177007744:0@lo:400: 00000100:00100000:1.0:1790710737.674191:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1877696177007872:0@lo:400: 00000100:00100000:0.0:1790710737.675366:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c64e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+12:3310:x1877696177007616:12345-0@lo:400: Request processed in 2250us (2746us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710737.675377:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1790710737.675829:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177008256:0@lo:400: 00000100:00100000:1.0:1790710737.675889:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710737.675935:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790710737.675943:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1877696177008128:0@lo:400: 00000100:00100000:1.0:1790710737.675969:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710737.676114:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177008128 00000100:00100000:0.0:1790710737.676121:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177008128 00000100:00100000:0.0:1790710737.676186:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790710737.676195:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1877696177008128:12345-0@lo:400: 00000100:00100000:0.0:1790710737.676254:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1877696177008128:12345-0@lo:400: Request processed in 60us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710737.676261:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790710737.676295:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1877696177008128:0@lo:400: 00000100:00100000:2.0:1790710737.676456:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177008256 00000100:00100000:2.0:1790710737.676461:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177008256 00000100:00100000:2.0:1790710737.676499:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790710737.676521:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1877696177008256:12345-0@lo:400: 00000100:00100000:2.0:1790710737.676559:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1877696177008256:12345-0@lo:400: Request processed in 54us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710737.676565:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1790710737.676658:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790710737.676663:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1790710737.676694:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51f4d5fb80 x1877696177008256/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790710753 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790710737.676705:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177008256:0@lo:400: 00000100:00100000:3.0:1790710737.676990:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d27fc27-b651-404a-bd8c-b798806fb18a:3310:1877696177007616:0@lo:400: 10000000:01000000:2.0:1790710737.863635:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1790710737.863644:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c51ff4b3000 from 39 10000000:01000000:2.0:1790710737.863650:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790710737.863718:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c8047e00/0xcbad34b281570d18 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710737.863731:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.146@tcp lock: ffff9c51c8047e00/0xcbad34b281570d18 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710737.863742:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.146@tcp lock: ffff9c51c8047e00/0xcbad34b281570d18 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710737.863767:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d5ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177008384:0@lo:101: 00000100:00100000:2.0:1790710737.864077:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710737.864168:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f9f1cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1790710737.865892:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177008384 00000100:00100000:1.0:1790710737.865907:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177008384 00000100:00100000:1.0:1790710737.865979:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1790710737.865990:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c64e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+12:5842:x1877696177008384:12345-0@lo:101: 00010000:00010000:1.0:1790710737.866007:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790710737.866028:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c51c6480a00/0xcbad34b281570d1f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbad34b281570d18 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710737.866057:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c51c6480a00/0xcbad34b281570d1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbad34b281570d18 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710737.866069:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c51c6480a00/0xcbad34b281570d1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281570d18 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710737.866078:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c6480a00, rc 0) 00000100:00100000:1.0:1790710737.866458:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c64e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+13:5842:x1877696177008384:12345-0@lo:101: Request processed in 470us (2381us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710737.866466:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1790710737.876057:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d5ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177008384:0@lo:101: 00010000:00010000:2.0:1790710737.876105:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.146@tcp lock: ffff9c51c8047e00/0xcbad34b281570d18 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570d1f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710737.876116:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.146@tcp lock: ffff9c51c8047e00/0xcbad34b281570d18 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbad34b281570d1f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710737.876389:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f8ce7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177008512:0@lo:501: 00000100:00100000:3.0:1790710737.876453:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710737.876554:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f9b2d180 going to sleep for 11 seconds 00000100:00100000:0.0:1790710737.885740:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177008512 00000100:00100000:0.0:1790710737.885755:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177008512 00000100:00100000:0.0:1790710737.885838:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1790710737.885850:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c64e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+13:5842:x1877696177008512:12345-0@lo:501: 00000100:00100000:0.0:1790710737.886198:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c64e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+13:5842:x1877696177008512:12345-0@lo:501: Request processed in 349us (9743us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710737.886206:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1790710737.886977:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f8ce7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177008512:0@lo:501: 00000100:00100000:3.0:1790710737.887028:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f8ce7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177008640:0@lo:503: 00000100:00100000:3.0:1790710737.887085:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710737.887149:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f9b2d180 going to sleep for 11 seconds 00000100:00100000:1.0:1790710737.887358:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710737.887406:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710737.887429:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710737.887455:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710737.887477:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158110336 00000100:00100000:1.0:1790710737.887482:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158110336 00000100:00100000:1.0:1790710737.887530:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158110208 00000100:00100000:1.0:1790710737.887534:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158110208 00000100:00100000:1.0:1790710737.887553:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 11 00000100:00100000:1.0:1790710737.887562:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+5:2356:x1877696158110336:12345-192.168.206.46@tcp:400: 00000100:00100000:1.0:1790710737.887632:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+5:2356:x1877696158110336:12345-192.168.206.46@tcp:400: Request processed in 70us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710737.887639:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 11 00000100:00100000:1.0:1790710737.887654:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 12 00000100:00100000:1.0:1790710737.887662:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+5:2356:x1877696158110208:12345-192.168.206.46@tcp:400: 00000100:00100000:1.0:1790710737.887700:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+5:2356:x1877696158110208:12345-192.168.206.46@tcp:400: Request processed in 39us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710737.887719:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 12 00000100:00080000:1.0:1790710737.887833:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790710737.887836:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790710737.887849:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177008640 00000100:00100000:1.0:1790710737.887853:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177008640 00000100:00100000:1.0:1790710737.887873:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158109952 00000100:00100000:1.0:1790710737.887876:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158109952 00000100:00100000:1.0:1790710737.887889:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1790710737.887895:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c64e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+13:5842:x1877696177008640:12345-0@lo:503: 00000100:00100000:1.0:1790710737.888058:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c64e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+13:5842:x1877696177008640:12345-0@lo:503: Request processed in 162us (973us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710737.888074:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1790710737.888103:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 135 00000100:00100000:1.0:1790710737.888111:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c80fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b75d7a5-152f-4db9-bf19-5fe279a322e3+8:2356:x1877696158109952:12345-192.168.206.46@tcp:400: 00000100:00100000:1.0:1790710737.888168:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c80fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b75d7a5-152f-4db9-bf19-5fe279a322e3+8:2356:x1877696158109952:12345-192.168.206.46@tcp:400: Request processed in 57us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710737.888175:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 135 00000100:00100000:2.0:1790710737.889803:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f8ce7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177008640:0@lo:503: 00000100:00100000:3.0:1790710737.890841:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158110080 00000100:00100000:3.0:1790710737.890858:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158110080 00000100:00100000:3.0:1790710737.890918:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 29 00000100:00100000:3.0:1790710737.890927:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:2356:x1877696158110080:12345-192.168.206.46@tcp:400: 00000100:00100000:3.0:1790710737.890993:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:2356:x1877696158110080:12345-192.168.206.46@tcp:400: Request processed in 67us (3636us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710737.891000:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 29 00000100:00080000:3.0:1790710737.891021:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790710737.897279:0:8464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51fef71880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d27fc27-b651-404a-bd8c-b798806fb18a:8464:1877696177008768:0@lo:502: 00000100:00100000:0.0:1790710737.897370:0:8464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710737.897428:0:8464:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f4ecfcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790710737.897494:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177008768 00000100:00100000:2.0:1790710737.897501:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177008768 00000100:00100000:2.0:1790710737.897546:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1790710737.897555:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c80fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+13:8464:x1877696177008768:12345-0@lo:502: 00000100:00100000:2.0:1790710737.898057:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c80fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+13:8464:x1877696177008768:12345-0@lo:502: Request processed in 501us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710737.898065:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1790710737.898470:0:8464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51fef71880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d27fc27-b651-404a-bd8c-b798806fb18a:8464:1877696177008768:0@lo:502: 00000100:00100000:0.0:1790710737.898524:0:8464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51fef71880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d27fc27-b651-404a-bd8c-b798806fb18a:8464:1877696177008896:0@lo:502: 00000100:00100000:0.0:1790710737.898562:0:8464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710737.898894:0:8464:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f4ecfcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790710737.898961:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177008896 00000100:00100000:1.0:1790710737.898966:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177008896 00000100:00100000:1.0:1790710737.899011:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1790710737.899020:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c80fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+13:8464:x1877696177008896:12345-0@lo:502: 00000100:00100000:1.0:1790710737.899235:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c80fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+13:8464:x1877696177008896:12345-0@lo:502: Request processed in 215us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710737.899242:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1790710737.899910:0:8464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51fef71880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d27fc27-b651-404a-bd8c-b798806fb18a:8464:1877696177008896:0@lo:502: 00000040:00080000:0.0:1790710737.899937:0:8464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1790710737.904417:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1790710737.904450:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790710737.904462:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c8047e00/0xcbad34b281570d18 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570d1f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710737.904475:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.146@tcp lock: ffff9c51c8047e00/0xcbad34b281570d18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570d1f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790710737.904486:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1790710737.904489:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1790710737.904492:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1790710737.904529:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c13fc200/0xcbad34b281570d26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710737.904537:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.146@tcp lock: ffff9c51c13fc200/0xcbad34b281570d26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710737.904547:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.146@tcp lock: ffff9c51c13fc200/0xcbad34b281570d26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710737.904579:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f8ce6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177009024:0@lo:101: 00000100:00100000:3.0:1790710737.904644:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710737.905088:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f9b2d780 going to sleep for 11 seconds 00000100:00100000:1.0:1790710737.905411:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177009024 00000100:00100000:1.0:1790710737.905419:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177009024 00000100:00100000:1.0:1790710737.905471:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1790710737.905481:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c80fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+13:5842:x1877696177009024:12345-0@lo:101: 00010000:00010000:1.0:1790710737.905494:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790710737.905507:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c51c6481600/0xcbad34b281570d2d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbad34b281570d26 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710737.905530:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c51c6481600/0xcbad34b281570d2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbad34b281570d26 expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710737.905541:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c51c6481600/0xcbad34b281570d2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281570d26 expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710737.905562:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c6481600, rc 0) 00000100:00100000:1.0:1790710737.905634:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c80fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+14:5842:x1877696177009024:12345-0@lo:101: Request processed in 155us (989us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710737.905642:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1790710737.905737:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f8ce6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177009024:0@lo:101: 00010000:00010000:0.0:1790710737.905753:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.146@tcp lock: ffff9c51c13fc200/0xcbad34b281570d26 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570d2d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710737.905762:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.146@tcp lock: ffff9c51c13fc200/0xcbad34b281570d26 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbad34b281570d2d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710737.905838:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51fef71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177009152:0@lo:501: 00000100:00100000:0.0:1790710737.905866:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710737.905895:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f4ecfcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790710737.906501:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177009152 00000100:00100000:2.0:1790710737.906506:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177009152 00000100:00100000:2.0:1790710737.906538:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1790710737.906546:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c80f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+14:5842:x1877696177009152:12345-0@lo:501: 00000100:00100000:2.0:1790710737.906988:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c80f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+14:5842:x1877696177009152:12345-0@lo:501: Request processed in 442us (1119us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710737.906995:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1790710737.907174:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51fef71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177009152:0@lo:501: 00000100:00100000:0.0:1790710737.907225:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51fef71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177009280:0@lo:503: 00000100:00100000:0.0:1790710737.907267:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710737.907287:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f4ecfcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790710737.907410:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177009280 00000100:00100000:1.0:1790710737.907416:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177009280 00000100:00100000:1.0:1790710737.907435:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1790710737.907441:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c80f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+14:5842:x1877696177009280:12345-0@lo:503: 00000100:00100000:1.0:1790710737.907600:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c80f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+14:5842:x1877696177009280:12345-0@lo:503: Request processed in 158us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710737.907607:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1790710737.907991:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51fef71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177009280:0@lo:503: 00000100:00100000:2.0:1790710737.911802:0:8465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d5ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d27fc27-b651-404a-bd8c-b798806fb18a:8465:1877696177009408:0@lo:502: 00000100:00100000:2.0:1790710737.911954:0:8465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710737.912040:0:8465:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f9f1c600 going to sleep for 11 seconds 00000100:00100000:1.0:1790710737.912082:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177009408 00000100:00100000:1.0:1790710737.912089:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177009408 00000100:00100000:1.0:1790710737.912563:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1790710737.912583:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c80fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+14:8465:x1877696177009408:12345-0@lo:502: 00000100:00100000:1.0:1790710737.912811:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c80fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+14:8465:x1877696177009408:12345-0@lo:502: Request processed in 239us (857us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710737.912830:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1790710737.912921:0:8465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d5ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d27fc27-b651-404a-bd8c-b798806fb18a:8465:1877696177009408:0@lo:502: 00000020:01000000:2.0:1790710737.912948:0:8465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790710737.912962:0:8465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790710737.912964:0:8465:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1790710737.912969:0:8465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1790710737.912995:0:8465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d5ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d27fc27-b651-404a-bd8c-b798806fb18a:8465:1877696177009536:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790710737.913043:0:8465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710737.914103:0:8465:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51e0311e40 going to sleep for 11 seconds 00000100:00100000:3.0:1790710737.914333:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177009536 00000100:00100000:3.0:1790710737.914339:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177009536 00000100:00100000:3.0:1790710737.914374:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1790710737.914383:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c80f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+14:8465:x1877696177009536:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790710737.914847:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c80f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+14:8465:x1877696177009536:12345-0@lo:502:llog_process_th.0 Request processed in 464us (1802us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710737.914855:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1790710737.919024:0:8465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d5ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d27fc27-b651-404a-bd8c-b798806fb18a:8465:1877696177009536:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790710737.919176:0:8465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790710737.919199:0:8465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790710737.919201:0:8465:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1790710737.919206:0:8465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1790710737.919683:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1790710737.919836:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.146@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1790710737.919847:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c13fc200/0xcbad34b281570d26 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570d2d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710737.919858:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.146@tcp lock: ffff9c51c13fc200/0xcbad34b281570d26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570d2d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790710737.919868:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1790710737.919871:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c51f444d000 from 39 10000000:01000000:2.0:1790710737.919873:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790710737.919907:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c8047200/0xcbad34b281570d34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710737.919915:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.146@tcp lock: ffff9c51c8047200/0xcbad34b281570d34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710737.919924:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.146@tcp lock: ffff9c51c8047200/0xcbad34b281570d34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710737.919946:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d5ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177009664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790710737.920007:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710737.920066:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51e0311e40 going to sleep for 11 seconds 00000100:00100000:3.0:1790710737.920170:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177009664 00000100:00100000:3.0:1790710737.920187:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177009664 00000100:00100000:3.0:1790710737.920227:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1790710737.920236:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c80f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+14:5842:x1877696177009664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790710737.920249:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790710737.920262:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c51c13fc800/0xcbad34b281570d3b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbad34b281570d34 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710737.920284:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c51c13fc800/0xcbad34b281570d3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbad34b281570d34 expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710737.920295:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c51c13fc800/0xcbad34b281570d3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281570d34 expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710737.920303:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c13fc800, rc 0) 00000100:00100000:3.0:1790710737.920884:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c80f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+15:5842:x1877696177009664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 646us (874us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710737.920893:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1790710737.920984:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d5ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177009664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790710737.921001:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.146@tcp lock: ffff9c51c8047200/0xcbad34b281570d34 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570d3b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710737.921026:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.146@tcp lock: ffff9c51c8047200/0xcbad34b281570d34 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbad34b281570d3b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710737.921084:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c812d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177009792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790710737.921112:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710737.921153:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51ff5db3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790710737.921353:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177009792 00000100:00100000:0.0:1790710737.921359:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177009792 00000100:00100000:1.0:1790710737.921536:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1790710737.921543:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c80fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+15:5842:x1877696177009792:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790710737.922158:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c80fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+15:5842:x1877696177009792:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 613us (1043us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710737.922166:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1790710737.922508:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c812d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177009792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790710737.922566:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51fef71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177009920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790710737.922787:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710737.922872:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f4ecfcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790710737.922906:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177009920 00000100:00100000:2.0:1790710737.922912:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177009920 00000100:00100000:2.0:1790710737.922992:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1790710737.923000:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c80f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+15:5842:x1877696177009920:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790710737.923200:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c80f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+15:5842:x1877696177009920:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 200us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710737.923208:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1790710737.923285:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51fef71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177009920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790710737.923958:0:8466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51fef71880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d27fc27-b651-404a-bd8c-b798806fb18a:8466:1877696177010048:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790710737.924006:0:8466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710737.924850:0:8466:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f4ecf240 going to sleep for 11 seconds 00000100:00100000:3.0:1790710737.924916:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177010048 00000100:00100000:3.0:1790710737.924923:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177010048 00000100:00100000:3.0:1790710737.924960:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1790710737.924977:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c80f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+15:8466:x1877696177010048:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790710737.926021:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c80f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+15:8466:x1877696177010048:12345-0@lo:502:llog_process_th.0 Request processed in 1040us (2010us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710737.926032:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1790710737.926180:0:8466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51fef71880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d27fc27-b651-404a-bd8c-b798806fb18a:8466:1877696177010048:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790710737.926250:0:8466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51fef71880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d27fc27-b651-404a-bd8c-b798806fb18a:8466:1877696177010176:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790710737.926297:0:8466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710737.926335:0:8466:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f4ecf240 going to sleep for 11 seconds 00000100:00100000:3.0:1790710737.929268:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177010176 00000100:00100000:3.0:1790710737.929282:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177010176 00000100:00100000:3.0:1790710737.929344:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1790710737.929355:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c80fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+15:8466:x1877696177010176:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790710737.929648:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c80fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+15:8466:x1877696177010176:12345-0@lo:502:llog_process_th.0 Request processed in 294us (3349us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710737.929656:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1790710737.932487:0:8466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51fef71880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d27fc27-b651-404a-bd8c-b798806fb18a:8466:1877696177010176:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1790710737.932535:0:8466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1790710737.932973:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1790710737.932993:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790710737.933005:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c8047200/0xcbad34b281570d34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570d3b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710737.933017:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.146@tcp lock: ffff9c51c8047200/0xcbad34b281570d34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570d3b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790710737.933027:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1790710737.933030:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1790710737.933033:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1790710737.933070:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c13fd000/0xcbad34b281570d42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710737.933078:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.146@tcp lock: ffff9c51c13fd000/0xcbad34b281570d42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710737.933087:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.146@tcp lock: ffff9c51c13fd000/0xcbad34b281570d42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710737.933119:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f8ce5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177010304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790710737.933204:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710737.933247:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f9b2dc00 going to sleep for 11 seconds 00000100:00100000:2.0:1790710737.933304:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177010304 00000100:00100000:2.0:1790710737.933319:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177010304 00000100:00100000:2.0:1790710737.933364:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1790710737.933373:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c80fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+15:5842:x1877696177010304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790710737.933387:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790710737.933399:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c51c8047400/0xcbad34b281570d49 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbad34b281570d42 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710737.933422:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c51c8047400/0xcbad34b281570d49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbad34b281570d42 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710737.933432:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c51c8047400/0xcbad34b281570d49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281570d42 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710737.933440:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c8047400, rc 0) 00000100:00100000:2.0:1790710737.933487:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c80fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+16:5842:x1877696177010304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710737.933495:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1790710737.933899:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f8ce5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177010304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790710737.933914:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.146@tcp lock: ffff9c51c13fd000/0xcbad34b281570d42 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570d49 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710737.933923:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.146@tcp lock: ffff9c51c13fd000/0xcbad34b281570d42 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbad34b281570d49 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710737.933974:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51fef71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177010432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790710737.934005:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710737.934022:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f4ecf240 going to sleep for 11 seconds 00000100:00100000:1.0:1790710737.934102:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177010432 00000100:00100000:1.0:1790710737.934108:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177010432 00000100:00100000:1.0:1790710737.934160:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1790710737.934168:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c80f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+16:5842:x1877696177010432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790710737.936073:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c80f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+16:5842:x1877696177010432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1898us (2059us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710737.936087:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1790710737.936304:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51fef71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177010432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790710737.936377:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51fef71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177010560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790710737.936433:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710737.936460:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f4ecf240 going to sleep for 11 seconds 00000100:00100000:3.0:1790710737.936852:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177010560 00000100:00100000:3.0:1790710737.936859:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177010560 00000100:00100000:3.0:1790710737.936903:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1790710737.936912:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c80f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+16:5842:x1877696177010560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790710737.937106:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c80f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+16:5842:x1877696177010560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 195us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710737.937114:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1790710737.937696:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51fef71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177010560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790710737.941540:0:8467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f8ce5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d27fc27-b651-404a-bd8c-b798806fb18a:8467:1877696177010688:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790710737.941814:0:8467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710737.941909:0:8467:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f9b2d180 going to sleep for 11 seconds 00000100:00100000:2.0:1790710737.941953:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177010688 00000100:00100000:2.0:1790710737.941961:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177010688 00000100:00100000:2.0:1790710737.942043:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1790710737.942060:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ee788050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+16:8467:x1877696177010688:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790710737.942603:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ee788050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+16:8467:x1877696177010688:12345-0@lo:502:llog_process_th.0 Request processed in 543us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710737.942612:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1790710737.942967:0:8467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f8ce5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d27fc27-b651-404a-bd8c-b798806fb18a:8467:1877696177010688:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790710737.942999:0:8467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790710737.943009:0:8467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790710737.943011:0:8467:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1790710737.943017:0:8467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1790710737.943050:0:8467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c812dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d27fc27-b651-404a-bd8c-b798806fb18a:8467:1877696177010816:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790710737.943096:0:8467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710737.943301:0:8467:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51ff5dbd80 going to sleep for 11 seconds 00000100:00100000:2.0:1790710737.943663:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177010816 00000100:00100000:2.0:1790710737.943767:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177010816 00000100:00100000:2.0:1790710737.943850:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1790710737.943858:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ee78b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+16:8467:x1877696177010816:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790710737.944049:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ee78b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+16:8467:x1877696177010816:12345-0@lo:502:llog_process_th.0 Request processed in 190us (951us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710737.944056:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1790710737.944146:0:8467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c812dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d27fc27-b651-404a-bd8c-b798806fb18a:8467:1877696177010816:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790710737.944189:0:8467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790710737.944195:0:8467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790710737.944197:0:8467:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1790710737.944201:0:8467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:1.0:1790710737.944258:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1790710737.944284:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.146@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1790710737.944294:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c13fd000/0xcbad34b281570d42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570d49 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710737.944305:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.146@tcp lock: ffff9c51c13fd000/0xcbad34b281570d42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570d49 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790710737.944327:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1790710737.944329:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c51c67ea000 from 39 10000000:01000000:1.0:1790710737.944332:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1790710737.944356:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c6480600/0xcbad34b281570d50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710737.944364:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.146@tcp lock: ffff9c51c6480600/0xcbad34b281570d50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710737.944373:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.146@tcp lock: ffff9c51c6480600/0xcbad34b281570d50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710737.944389:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c812dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177010944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790710737.944416:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710737.945059:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51ff5dbd80 going to sleep for 11 seconds 00000100:00100000:0.0:1790710737.945233:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177010944 00000100:00100000:0.0:1790710737.945240:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177010944 00000100:00100000:0.0:1790710737.945275:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1790710737.945283:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ee78ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+16:5842:x1877696177010944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790710737.945296:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790710737.945323:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c51c0030a00/0xcbad34b281570d57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbad34b281570d50 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710737.945344:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c51c0030a00/0xcbad34b281570d57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbad34b281570d50 expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710737.945353:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c51c0030a00/0xcbad34b281570d57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281570d50 expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710737.945361:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c0030a00, rc 0) 00000100:00100000:0.0:1790710737.945409:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ee78ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+17:5842:x1877696177010944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (992us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710737.945416:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1790710737.946247:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c812dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177010944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790710737.946278:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.146@tcp lock: ffff9c51c6480600/0xcbad34b281570d50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570d57 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710737.946289:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.146@tcp lock: ffff9c51c6480600/0xcbad34b281570d50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbad34b281570d57 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710737.946370:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c812dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177011072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790710737.946406:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710737.946436:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51ff5dbd80 going to sleep for 11 seconds 00000100:00100000:0.0:1790710737.946565:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177011072 00000100:00100000:0.0:1790710737.946578:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177011072 00000100:00100000:0.0:1790710737.946603:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1790710737.946609:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ee788c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+17:5842:x1877696177011072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790710737.947018:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ee788c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+17:5842:x1877696177011072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 407us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710737.947032:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1790710737.947112:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c812dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177011072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790710737.947174:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c812dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177011200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790710737.947213:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710737.947236:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51ff5dbd80 going to sleep for 11 seconds 00000100:00100000:0.0:1790710737.947286:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177011200 00000100:00100000:0.0:1790710737.947291:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177011200 00000100:00100000:0.0:1790710737.947684:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1790710737.947694:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ee789450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+17:5842:x1877696177011200:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790710737.947987:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ee789450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+17:5842:x1877696177011200:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 295us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710737.947994:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1790710737.948082:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c812dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177011200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790710737.948949:0:8468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c812dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d27fc27-b651-404a-bd8c-b798806fb18a:8468:1877696177011328:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790710737.949002:0:8468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710737.949038:0:8468:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51ff5dbc00 going to sleep for 11 seconds 00000100:00100000:0.0:1790710737.949080:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177011328 00000100:00100000:0.0:1790710737.949086:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177011328 00000100:00100000:0.0:1790710737.949114:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1790710737.949121:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ee78bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+17:8468:x1877696177011328:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790710737.949492:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ee78bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+17:8468:x1877696177011328:12345-0@lo:502:llog_process_th.0 Request processed in 370us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710737.949500:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1790710737.949861:0:8468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c812dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d27fc27-b651-404a-bd8c-b798806fb18a:8468:1877696177011328:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790710737.949909:0:8468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c812dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d27fc27-b651-404a-bd8c-b798806fb18a:8468:1877696177011456:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790710737.949951:0:8468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710737.949982:0:8468:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51ff5dbc00 going to sleep for 11 seconds 00000100:00100000:0.0:1790710737.950052:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177011456 00000100:00100000:0.0:1790710737.950057:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177011456 00000100:00100000:0.0:1790710737.950091:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1790710737.950099:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ee78a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+17:8468:x1877696177011456:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790710737.950287:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ee78a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+17:8468:x1877696177011456:12345-0@lo:502:llog_process_th.0 Request processed in 187us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710737.950295:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1790710737.950475:0:8468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c812dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d27fc27-b651-404a-bd8c-b798806fb18a:8468:1877696177011456:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1790710737.950844:0:8468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1790710737.951015:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1790710737.951040:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790710737.951050:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c6480600/0xcbad34b281570d50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570d57 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710737.951068:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.146@tcp lock: ffff9c51c6480600/0xcbad34b281570d50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570d57 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790710737.951077:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1790710737.951080:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1790710737.951083:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1790710737.951109:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c0030400/0xcbad34b281570d5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710737.951116:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.146@tcp lock: ffff9c51c0030400/0xcbad34b281570d5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710737.951229:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.146@tcp lock: ffff9c51c0030400/0xcbad34b281570d5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710737.951248:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51fef71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177011584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790710737.951286:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710737.951418:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f4ecf3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790710737.951454:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177011584 00000100:00100000:2.0:1790710737.951460:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177011584 00000100:00100000:2.0:1790710737.951530:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1790710737.951539:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ee78b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+17:5842:x1877696177011584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790710737.951549:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790710737.951561:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c51c8046600/0xcbad34b281570d65 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbad34b281570d5e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710737.951596:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c51c8046600/0xcbad34b281570d65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbad34b281570d5e expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710737.951606:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c51c8046600/0xcbad34b281570d65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281570d5e expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710737.951614:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c8046600, rc 0) 00000100:00100000:2.0:1790710737.951658:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ee78b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+18:5842:x1877696177011584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710737.951888:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51fef71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177011584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790710737.951910:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.146@tcp lock: ffff9c51c0030400/0xcbad34b281570d5e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570d65 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710737.951919:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.146@tcp lock: ffff9c51c0030400/0xcbad34b281570d5e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbad34b281570d65 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710737.951971:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c812dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177011712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790710737.952002:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710737.952027:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1790710737.952155:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51ff5dbc00 going to sleep for 11 seconds 00000100:00100000:2.0:1790710737.952262:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177011712 00000100:00100000:2.0:1790710737.952266:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177011712 00000100:00100000:2.0:1790710737.952284:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1790710737.952289:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ee78a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+18:5842:x1877696177011712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790710737.952544:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ee78a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+18:5842:x1877696177011712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 254us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710737.952550:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1790710737.952812:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c812dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177011712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790710737.952855:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c812dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177011840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790710737.952897:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710737.952928:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51ff5dbc00 going to sleep for 11 seconds 00000100:00100000:2.0:1790710737.953029:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177011840 00000100:00100000:2.0:1790710737.953033:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177011840 00000100:00100000:2.0:1790710737.953054:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1790710737.953059:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ee788450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+18:5842:x1877696177011840:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790710737.953224:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ee788450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+18:5842:x1877696177011840:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 163us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710737.953230:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1790710737.953322:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c812dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177011840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790710737.953959:0:8469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c812dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d27fc27-b651-404a-bd8c-b798806fb18a:8469:1877696177011968:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790710737.954003:0:8469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710737.954034:0:8469:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51ff5db240 going to sleep for 11 seconds 00000100:00100000:2.0:1790710737.954073:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177011968 00000100:00100000:2.0:1790710737.954078:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177011968 00000100:00100000:2.0:1790710737.954102:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1790710737.954108:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ee788850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+18:8469:x1877696177011968:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790710737.954306:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ee788850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+18:8469:x1877696177011968:12345-0@lo:502:llog_process_th.0 Request processed in 196us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710737.954324:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1790710737.954467:0:8469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c812dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d27fc27-b651-404a-bd8c-b798806fb18a:8469:1877696177011968:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790710737.954491:0:8469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790710737.954499:0:8469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790710737.954501:0:8469:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1790710737.954506:0:8469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1790710737.954527:0:8469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c812dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d27fc27-b651-404a-bd8c-b798806fb18a:8469:1877696177012096:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790710737.954559:0:8469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710737.954590:0:8469:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51ff5db240 going to sleep for 11 seconds 00000100:00100000:2.0:1790710737.954635:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177012096 00000100:00100000:2.0:1790710737.954639:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177012096 00000100:00100000:2.0:1790710737.954658:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1790710737.954663:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ee78a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+18:8469:x1877696177012096:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790710737.954956:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ee78a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+18:8469:x1877696177012096:12345-0@lo:502:llog_process_th.0 Request processed in 292us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710737.954964:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1790710737.955032:0:8469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c812dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d27fc27-b651-404a-bd8c-b798806fb18a:8469:1877696177012096:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790710737.955049:0:8469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790710737.955054:0:8469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790710737.955055:0:8469:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1790710737.955058:0:8469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1790710737.955279:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:2.0:1790710737.955302:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.146@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1790710737.955311:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c0030400/0xcbad34b281570d5e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570d65 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710737.955323:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.146@tcp lock: ffff9c51c0030400/0xcbad34b281570d5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570d65 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790710737.955332:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1790710737.955335:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9c51d02d19c0 from 1 10000000:01000000:2.0:1790710737.955338:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1790710737.955362:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c8046000/0xcbad34b281570d6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710737.955370:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.146@tcp lock: ffff9c51c8046000/0xcbad34b281570d6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710737.955379:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.146@tcp lock: ffff9c51c8046000/0xcbad34b281570d6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710737.955393:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d5d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177012224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790710737.955422:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710737.955481:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c5356240 going to sleep for 11 seconds 00000100:00100000:0.0:1790710737.955549:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177012224 00000100:00100000:0.0:1790710737.955554:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177012224 00000100:00100000:3.0:1790710737.955658:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1790710737.955679:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ee789850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+18:5842:x1877696177012224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790710737.955690:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790710737.955712:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c51c13fd200/0xcbad34b281570d73 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbad34b281570d6c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710737.955733:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c51c13fd200/0xcbad34b281570d73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbad34b281570d6c expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710737.955743:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c51c13fd200/0xcbad34b281570d73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281570d6c expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710737.955751:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c13fd200, rc 0) 00000100:00100000:3.0:1790710737.955794:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ee789850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+19:5842:x1877696177012224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710737.955800:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1790710737.956030:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d5d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177012224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790710737.956043:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.146@tcp lock: ffff9c51c8046000/0xcbad34b281570d6c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570d73 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710737.956059:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.146@tcp lock: ffff9c51c8046000/0xcbad34b281570d6c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbad34b281570d73 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710737.956106:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d5d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177012352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790710737.956153:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710737.956413:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c5356240 going to sleep for 11 seconds 00000100:00100000:1.0:1790710737.956446:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177012352 00000100:00100000:1.0:1790710737.956451:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177012352 00000100:00100000:1.0:1790710737.956490:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1790710737.956497:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ee789050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+19:5842:x1877696177012352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790710737.956980:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ee789050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+19:5842:x1877696177012352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 481us (824us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790710737.956988:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1790710737.957117:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d5d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177012352:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1790710737.957363:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.146@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1790710737.957372:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c8046000/0xcbad34b281570d6c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570d73 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710737.957382:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.146@tcp lock: ffff9c51c8046000/0xcbad34b281570d6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570d73 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710738.140974:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710738.143025:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158110464 00000100:00100000:2.0:1790710738.143041:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158110464 00000100:00100000:2.0:1790710738.143113:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 165 00000100:00100000:2.0:1790710738.143123:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ee78b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b75d7a5-152f-4db9-bf19-5fe279a322e3+8:5596:x1877696158110464:12345-192.168.206.46@tcp:101: 00010000:00010000:2.0:1790710738.143171:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790710738.143189:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c51c8047600/0xcbad34b281570d7a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x566877b057000352 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710738.143218:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c51c8047600/0xcbad34b281570d7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000352 expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710738.143229:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c51c8047600/0xcbad34b281570d7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000352 expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710738.143237:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c8047600, rc 0) 00000100:00100000:2.0:1790710738.143308:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ee78b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b75d7a5-152f-4db9-bf19-5fe279a322e3+9:5596:x1877696158110464:12345-192.168.206.46@tcp:101: Request processed in 186us (2342us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710738.143316:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 165 00000100:00100000:3.0:1790710738.152244:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710738.152351:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158110592 00000100:00100000:1.0:1790710738.152371:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158110592 00000100:00100000:1.0:1790710738.152427:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 166 00000100:00100000:1.0:1790710738.152446:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ee789c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b75d7a5-152f-4db9-bf19-5fe279a322e3+9:5596:x1877696158110592:12345-192.168.206.46@tcp:501: 00000100:00100000:1.0:1790710738.153055:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ee789c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b75d7a5-152f-4db9-bf19-5fe279a322e3+9:5596:x1877696158110592:12345-192.168.206.46@tcp:501: Request processed in 616us (815us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710738.153065:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 166 00000100:00100000:1.0:1790710738.155530:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710738.155770:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158110720 00000100:00100000:0.0:1790710738.155780:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158110720 00000100:00100000:0.0:1790710738.155849:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 167 00000100:00100000:0.0:1790710738.155870:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8ff8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b75d7a5-152f-4db9-bf19-5fe279a322e3+9:5596:x1877696158110720:12345-192.168.206.46@tcp:503: 00000100:00100000:0.0:1790710738.156185:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8ff8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b75d7a5-152f-4db9-bf19-5fe279a322e3+9:5596:x1877696158110720:12345-192.168.206.46@tcp:503: Request processed in 326us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710738.156193:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 167 00000100:00100000:0.0:1790710738.164781:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710738.165152:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158110848 00000100:00100000:1.0:1790710738.165163:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158110848 00000100:00100000:1.0:1790710738.165218:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 168 00000100:00100000:1.0:1790710738.165227:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8ff8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b75d7a5-152f-4db9-bf19-5fe279a322e3+9:6070:x1877696158110848:12345-192.168.206.46@tcp:502: 00000100:00100000:1.0:1790710738.165600:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8ff8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b75d7a5-152f-4db9-bf19-5fe279a322e3+9:6070:x1877696158110848:12345-192.168.206.46@tcp:502: Request processed in 372us (828us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710738.165618:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 168 00000100:00100000:3.0:1790710738.169100:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710738.169364:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158110976 00000100:00100000:2.0:1790710738.169388:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158110976 00000100:00100000:2.0:1790710738.169453:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 169 00000100:00100000:2.0:1790710738.169463:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8ffa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b75d7a5-152f-4db9-bf19-5fe279a322e3+9:6070:x1877696158110976:12345-192.168.206.46@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790710738.170004:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8ffa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b75d7a5-152f-4db9-bf19-5fe279a322e3+9:6070:x1877696158110976:12345-192.168.206.46@tcp:502:llog_process_th.0 Request processed in 540us (911us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710738.170013:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 169 00000100:00100000:2.0:1790710738.176288:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710738.176673:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158111104 00000100:00100000:1.0:1790710738.176683:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158111104 00000100:00100000:1.0:1790710738.176741:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 170 00000100:00100000:1.0:1790710738.176750:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8ff9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b75d7a5-152f-4db9-bf19-5fe279a322e3+9:5596:x1877696158111104:12345-192.168.206.46@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790710738.176767:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790710738.176783:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c51c6481e00/0xcbad34b281570d81 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x566877b057000359 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710738.176812:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c51c6481e00/0xcbad34b281570d81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000359 expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710738.177159:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c51c6481e00/0xcbad34b281570d81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000359 expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710738.177171:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c6481e00, rc 0) 00000100:00100000:1.0:1790710738.177282:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8ff9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b75d7a5-152f-4db9-bf19-5fe279a322e3+10:5596:x1877696158111104:12345-192.168.206.46@tcp:101:ll_cfg_requeue.0 Request processed in 532us (1001us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710738.177290:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 170 00000100:00100000:1.0:1790710738.184228:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51fef70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1877696177012480:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790710738.184295:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710738.184433:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177012480 00000100:00100000:0.0:1790710738.184450:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177012480 00000100:00100000:0.0:1790710738.184506:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790710738.184516:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c812dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877696177012480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790710738.184552:0:6700:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790710738.184607:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c812dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877696177012480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710738.184614:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790710738.185167:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00010000:00080000:1.0:1790710738.185264:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51fef70a80 x1877696177012480/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790710754 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790710738.185283:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51fef70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1877696177012480:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790710738.185456:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158111232 00000100:00100000:3.0:1790710738.185462:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158111232 00000100:00100000:3.0:1790710738.185503:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 171 00000100:00100000:3.0:1790710738.185511:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8ff9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b75d7a5-152f-4db9-bf19-5fe279a322e3+10:5596:x1877696158111232:12345-192.168.206.46@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790710738.185955:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8ff9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b75d7a5-152f-4db9-bf19-5fe279a322e3+10:5596:x1877696158111232:12345-192.168.206.46@tcp:501:ll_cfg_requeue.0 Request processed in 443us (789us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790710738.185963:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 171 00010000:00010000:1.0:1790710738.439291:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790710738.696226:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790710738.696250:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c812e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1877696177012608:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790710738.696318:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710738.696599:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177012608 00000100:00100000:1.0:1790710738.696618:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177012608 00000100:00100000:1.0:1790710738.697855:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790710738.697873:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f8ce4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877696177012608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790710738.697913:0:6700:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790710738.697995:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f8ce4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877696177012608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (1677us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710738.698002:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1790710738.698099:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51c812e680 x1877696177012608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790710754 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790710738.698119:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c812e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1877696177012608:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1790710739.464349:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1790710739.584001:0:8507:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff345b2500 20000000:00000080:3.0:1790710739.584016:0:8507:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c51f3d54c00 uarg=0000000000000000 20000000:01000000:3.0:1790710739.584050:0:8507:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1790710739.584055:0:8507:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1790710739.584059:0:8507:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1790710739.594547:0:8508:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1790710739.594709:0:8507:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1790710739.601896:0:8507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1790710739.601959:0:8507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1790710739.602017:0:8507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1790710739.602037:0:8507:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1790710739.602056:0:8507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c51c8046e00/0xcbad34b281570d88 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710739.602074:0:8507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c51c8047000/0xcbad34b281570afd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281570af6 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710739.602082:0:8507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c51c1645000/0xcbad34b281570b5f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281570b58 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710739.602088:0:8507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c51c13fc400/0xcbad34b281570c2a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281570c23 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710739.602097:0:8507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c51c13fcc00/0xcbad34b281570ce7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000321 expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710739.602105:0:8507:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c51c8046e00/0xcbad34b281570d88 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710739.602588:0:8507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c51c13fcc00/0xcbad34b281570ce7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.206.46@tcp remote: 0x566877b057000321 expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710739.602606:0:8507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c51c13fcc00/0xcbad34b281570ce7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000321 expref: 9 pid: 5840 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710739.602619:0:8507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d5ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8507:1877696177012736:192.168.206.46@tcp:104: 00010000:00010000:2.0:1790710739.603087:0:8507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c51c13fc400/0xcbad34b281570c2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbad34b281570c23 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710739.603096:0:8507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c51c13fc400/0xcbad34b281570c2a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbad34b281570c23 expref: 18 pid: 5840 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710739.603105:0:8507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d5c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8507:1877696177012864:0@lo:104: 00000100:00100000:2.0:1790710739.603170:0:8507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790710739.603213:0:8507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c51c1645000/0xcbad34b281570b5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbad34b281570b58 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710739.603223:0:8507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c51c1645000/0xcbad34b281570b5f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbad34b281570b58 expref: 18 pid: 5837 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710739.603239:0:8507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d5dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8507:1877696177012992:0@lo:104: 00000100:00100000:2.0:1790710739.603264:0:8507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790710739.603295:0:8507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c51c8047000/0xcbad34b281570afd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbad34b281570af6 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710739.603303:0:8507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c51c8047000/0xcbad34b281570afd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbad34b281570af6 expref: 18 pid: 5840 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710739.603325:0:5828:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1790710739.603326:0:8507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d5c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8507:1877696177013120:0@lo:104: 00000100:00100000:0.0:1790710739.603344:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177012864 00000100:00100000:0.0:1790710739.603351:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177012864 00000100:00100000:2.0:1790710739.603359:0:8507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710739.603371:0:8507:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f9f1c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790710739.603391:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177012992 00000100:00100000:0.0:1790710739.603395:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177012992 00000100:00100000:0.0:1790710739.603406:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177013120 00000100:00100000:0.0:1790710739.603408:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177013120 00000100:00100000:0.0:1790710739.603422:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790710739.603430:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d5c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5d27fc27-b651-404a-bd8c-b798806fb18a+5:8507:x1877696177012864:12345-0@lo:104: 00010000:00010000:0.0:1790710739.603444:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.146@tcp lock: ffff9c51c1645c00/0xcbad34b281570c23 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbad34b281570c2a expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710739.603519:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790710739.603525:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d5c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5d27fc27-b651-404a-bd8c-b798806fb18a+5:8507:x1877696177012864:12345-0@lo:104: Request processed in 97us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710739.603532:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790710739.603561:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790710739.603571:0:8507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d5c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8507:1877696177012864:0@lo:104: 00000100:00100000:0.0:1790710739.603571:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f464a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5d27fc27-b651-404a-bd8c-b798806fb18a+4:8507:x1877696177012992:12345-0@lo:104: 00010000:00010000:0.0:1790710739.603584:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.146@tcp lock: ffff9c51c8047800/0xcbad34b281570b58 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbad34b281570b5f expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710739.603630:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:1.0:1790710739.603634:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:0.0:1790710739.603636:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f464a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5d27fc27-b651-404a-bd8c-b798806fb18a+4:8507:x1877696177012992:12345-0@lo:104: Request processed in 68us (371us total) trans 0 rc 0/0 00010000:00010000:1.0:1790710739.603643:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.146@tcp lock: ffff9c51c1645c00/0xcbad34b281570c23 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbad34b281570c2a expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710739.603644:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:1.0:1790710739.603654:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c1645c00 already unused, calling callback (ffffffffc1cdfc20) 10000000:00010000:1.0:1790710739.603669:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.146@tcp lock: ffff9c51c1645c00/0xcbad34b281570c23 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbad34b281570c2a expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710739.603680:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1790710739.603688:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.146@tcp lock: ffff9c51c1645c00/0xcbad34b281570c23 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbad34b281570c2a expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710739.603690:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5d27fc27-b651-404a-bd8c-b798806fb18a+3:8507:x1877696177013120:12345-0@lo:104: 10000000:00010000:1.0:1790710739.603704:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.146@tcp lock: ffff9c51c1645c00/0xcbad34b281570c23 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbad34b281570c2a expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710739.603704:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.146@tcp lock: ffff9c51c1644a00/0xcbad34b281570af6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbad34b281570afd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710739.603728:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1790710739.603732:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5d27fc27-b651-404a-bd8c-b798806fb18a+3:8507:x1877696177013120:12345-0@lo:104: Request processed in 45us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710739.603737:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1790710739.603893:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:2.0:1790710739.603936:0:8507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d5dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8507:1877696177012992:0@lo:104: 00000100:00100000:2.0:1790710739.603944:0:8507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d5c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8507:1877696177013120:0@lo:104: 10000000:01000000:1.0:1790710739.603984:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790710739.604019:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.146@tcp lock: ffff9c51c1645c00/0xcbad34b281570c23 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281570c2a expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710739.604025:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790710739.604047:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.146@tcp lock: ffff9c51c1645c00/0xcbad34b281570c23 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281570c2a expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710739.604053:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.146@tcp lock: ffff9c51c1645c00/0xcbad34b281570c23 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281570c2a expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710739.604072:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790710739.604076:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.146@tcp lock: ffff9c51c1644a00/0xcbad34b281570af6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbad34b281570afd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710739.604081:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c1644a00 already unused, calling callback (ffffffffc1cdfc20) 10000000:00010000:1.0:1790710739.604084:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.146@tcp lock: ffff9c51c1644a00/0xcbad34b281570af6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbad34b281570afd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710739.604090:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.146@tcp lock: ffff9c51c1644a00/0xcbad34b281570af6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbad34b281570afd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790710739.604097:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.146@tcp lock: ffff9c51c1644a00/0xcbad34b281570af6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbad34b281570afd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790710739.604102:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1790710739.604114:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c812f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d27fc27-b651-404a-bd8c-b798806fb18a:3310:1877696177013248:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790710739.604117:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.146@tcp lock: ffff9c51c1644a00/0xcbad34b281570af6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281570afd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710739.604152:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790710739.604166:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.146@tcp lock: ffff9c51c1644a00/0xcbad34b281570af6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281570afd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710739.604172:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.146@tcp lock: ffff9c51c1644a00/0xcbad34b281570af6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281570afd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710739.604181:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790710739.604183:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790710739.604184:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790710739.604197:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c812d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d27fc27-b651-404a-bd8c-b798806fb18a:3311:1877696177013376:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790710739.604316:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710739.604353:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177013248 00000100:00100000:2.0:1790710739.604359:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177013248 00010000:00010000:2.0:1790710739.604384:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c51c13fc400/0xcbad34b281570c2a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbad34b281570c23 expref: 19 pid: 5840 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710739.604395:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790710739.604398:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790710739.604400:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790710739.604410:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790710739.604418:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51fef72d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d27fc27-b651-404a-bd8c-b798806fb18a+19:3310:x1877696177013248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790710739.604428:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790710739.604433:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c51c13fc400/0xcbad34b281570c2a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbad34b281570c23 expref: 19 pid: 5840 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710739.604441:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c51c13fc400/0xcbad34b281570c2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbad34b281570c23 expref: 19 pid: 5840 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710739.604452:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c51c13fc400/0xcbad34b281570c2a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbad34b281570c23 expref: 19 pid: 5840 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710739.604463:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790710739.604497:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51fef72d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d27fc27-b651-404a-bd8c-b798806fb18a+18:3310:x1877696177013248:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710739.604512:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1790710739.604532:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.146@tcp lock: ffff9c51c8047800/0xcbad34b281570b58 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbad34b281570b5f expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710739.604539:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c8047800 already unused, calling callback (ffffffffc1cdfc20) 10000000:00010000:2.0:1790710739.604542:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.146@tcp lock: ffff9c51c8047800/0xcbad34b281570b58 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbad34b281570b5f expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710739.604548:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.146@tcp lock: ffff9c51c8047800/0xcbad34b281570b58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbad34b281570b5f expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790710739.604554:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.146@tcp lock: ffff9c51c8047800/0xcbad34b281570b58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbad34b281570b5f expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790710739.604559:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790710739.604576:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.146@tcp lock: ffff9c51c8047800/0xcbad34b281570b58 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281570b5f expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710739.604582:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790710739.604596:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.146@tcp lock: ffff9c51c8047800/0xcbad34b281570b58 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281570b5f expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710739.604602:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.146@tcp lock: ffff9c51c8047800/0xcbad34b281570b58 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281570b5f expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710739.604614:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710739.604616:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710739.604617:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790710739.604629:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d27fc27-b651-404a-bd8c-b798806fb18a:3312:1877696177013504:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790710739.604662:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710739.604883:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710739.604884:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c812f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d27fc27-b651-404a-bd8c-b798806fb18a:3310:1877696177013248:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790710739.604962:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177013504 00000100:00100000:0.0:1790710739.604966:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177013504 00010000:00010000:0.0:1790710739.604983:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c51c1645000/0xcbad34b281570b5f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbad34b281570b58 expref: 18 pid: 5837 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710739.605017:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177013376 00000100:00100000:0.0:1790710739.605020:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177013376 00000100:00100000:2.0:1790710739.605022:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790710739.605035:0:8449:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5d27fc27-b651-404a-bd8c-b798806fb18a+19:3312:x1877696177013504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790710739.605035:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c51c8047000/0xcbad34b281570afd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbad34b281570af6 expref: 19 pid: 5840 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710739.605049:0:8449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790710739.605056:0:8449:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c51c1645000/0xcbad34b281570b5f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbad34b281570b58 expref: 19 pid: 5837 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710739.605062:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00010000:00010000:2.0:1790710739.605071:0:8449:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c51c1645000/0xcbad34b281570b5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbad34b281570b58 expref: 19 pid: 5837 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710739.605082:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c51c1645000/0xcbad34b281570b5f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbad34b281570b58 expref: 19 pid: 5837 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710739.605090:0:8449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790710739.605119:0:8449:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5d27fc27-b651-404a-bd8c-b798806fb18a+18:3312:x1877696177013504:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710739.605146:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790710739.605174:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d27fc27-b651-404a-bd8c-b798806fb18a:3312:1877696177013504:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790710739.605318:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c812c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d27fc27-b651-404a-bd8c-b798806fb18a+17:3311:x1877696177013376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790710739.605329:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790710739.605334:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c51c8047000/0xcbad34b281570afd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbad34b281570af6 expref: 17 pid: 5840 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710739.605342:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c51c8047000/0xcbad34b281570afd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbad34b281570af6 expref: 17 pid: 5840 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710739.605352:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c51c8047000/0xcbad34b281570afd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbad34b281570af6 expref: 17 pid: 5840 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710739.605361:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790710739.605400:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c812c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d27fc27-b651-404a-bd8c-b798806fb18a+16:3311:x1877696177013376:12345-0@lo:103:ldlm_bl.0 Request processed in 329us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710739.605407:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790710739.605458:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c812d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d27fc27-b651-404a-bd8c-b798806fb18a:3311:1877696177013376:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790710739.614278:0:8507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d5ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8507:1877696177012736:192.168.206.46@tcp:104: 00010000:00010000:2.0:1790710739.614315:0:8507:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c51c8046e00/0xcbad34b281570d88 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710739.614487:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710739.615719:0:8449:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158111360 00000100:00100000:2.0:1790710739.615729:0:8449:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158111360 00010000:00010000:2.0:1790710739.615774:0:8449:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c51c13fcc00/0xcbad34b281570ce7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000321 expref: 10 pid: 5840 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710739.615828:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 24 00000100:00100000:2.0:1790710739.615850:0:8449:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51fef72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b75d7a5-152f-4db9-bf19-5fe279a322e3+10:2358:x1877696158111360:12345-192.168.206.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790710739.615867:0:8449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790710739.615872:0:8449:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c51c13fcc00/0xcbad34b281570ce7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000321 expref: 10 pid: 5840 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710739.615884:0:8449:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c51c13fcc00/0xcbad34b281570ce7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000321 expref: 10 pid: 5840 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710739.615900:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c51c13fcc00/0xcbad34b281570ce7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000321 expref: 10 pid: 5840 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710739.615914:0:8449:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c51c8046e00/0xcbad34b281570d88 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710739.615921:0:8449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c51c8046e00/0xcbad34b281570d88 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710739.615935:0:8449:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c51c8046e00/0xcbad34b281570d88 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710739.615942:0:8449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c51c8046e00/0xcbad34b281570d88 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710739.615948:0:8449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c51c8046e00/0xcbad34b281570d88 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710739.615954:0:8449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c51c8046e00/0xcbad34b281570d88 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710739.615960:0:8449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c8046e00 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:2.0:1790710739.615964:0:8449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c51c8046e00/0xcbad34b281570d88 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710739.615978:0:8449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c51c8046e00/0xcbad34b281570d88 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710739.616001:0:8449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c51c8046e00/0xcbad34b281570d88 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710739.616012:0:8449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790710739.616026:0:8507:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c51c8046e00/0xcbad34b281570d88 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710739.616038:0:8507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c51c8046e00/0xcbad34b281570d88 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710739.616046:0:8507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c51c8046e00/0xcbad34b281570d88 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710739.616074:0:8449:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51fef72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b75d7a5-152f-4db9-bf19-5fe279a322e3+9:2358:x1877696158111360:12345-192.168.206.46@tcp:103:ldlm_bl.0 Request processed in 224us (1587us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710739.616083:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 24 00010000:00010000:1.0:1790710740.487249:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790710741.150163:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710741.150277:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158111488 00000100:00100000:0.0:1790710741.150288:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158111488 00000100:00100000:0.0:1790710741.150339:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 172 00000100:00100000:0.0:1790710741.150347:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8ffb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b75d7a5-152f-4db9-bf19-5fe279a322e3+9:5596:x1877696158111488:12345-192.168.206.46@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790710741.150363:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790710741.150382:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c51c0030c00/0xcbad34b281570d8f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x566877b057000360 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710741.150409:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c51c0030c00/0xcbad34b281570d8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000360 expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710741.150430:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c51c0030c00/0xcbad34b281570d8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000360 expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710741.150439:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c0030c00, rc 0) 00000100:00100000:0.0:1790710741.150497:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8ffb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b75d7a5-152f-4db9-bf19-5fe279a322e3+10:5596:x1877696158111488:12345-192.168.206.46@tcp:101:ll_cfg_requeue.0 Request processed in 150us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710741.150504:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 172 00000100:00100000:1.0:1790710741.153347:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710741.153448:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158111616 00000100:00100000:3.0:1790710741.153458:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158111616 00000100:00100000:3.0:1790710741.153508:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 173 00000100:00100000:3.0:1790710741.153517:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8ff9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b75d7a5-152f-4db9-bf19-5fe279a322e3+10:5596:x1877696158111616:12345-192.168.206.46@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790710741.153791:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8ff9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b75d7a5-152f-4db9-bf19-5fe279a322e3+10:5596:x1877696158111616:12345-192.168.206.46@tcp:501:ll_cfg_requeue.0 Request processed in 274us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710741.153809:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 173 00000100:00100000:3.0:1790710741.161677:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710741.161758:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158111744 00000100:00100000:1.0:1790710741.161769:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158111744 00000100:00100000:1.0:1790710741.161831:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 174 00000100:00100000:1.0:1790710741.161841:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8ff8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b75d7a5-152f-4db9-bf19-5fe279a322e3+10:5596:x1877696158111744:12345-192.168.206.46@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790710741.162067:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8ff8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b75d7a5-152f-4db9-bf19-5fe279a322e3+10:5596:x1877696158111744:12345-192.168.206.46@tcp:503:ll_cfg_requeue.0 Request processed in 227us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710741.162076:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 174 00000100:00100000:1.0:1790710741.179821:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710741.181217:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158111872 00000100:00100000:0.0:1790710741.181230:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158111872 00000100:00100000:0.0:1790710741.181282:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 175 00000100:00100000:0.0:1790710741.181291:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8ffb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b75d7a5-152f-4db9-bf19-5fe279a322e3+10:6134:x1877696158111872:12345-192.168.206.46@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790710741.181582:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8ffb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b75d7a5-152f-4db9-bf19-5fe279a322e3+10:6134:x1877696158111872:12345-192.168.206.46@tcp:502:llog_process_th.0 Request processed in 290us (1778us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710741.181591:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 175 00000100:00100000:2.0:1790710741.184504:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710741.184579:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158112000 00000100:00100000:3.0:1790710741.184588:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158112000 00000100:00100000:3.0:1790710741.184640:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 176 00000100:00100000:3.0:1790710741.184649:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8ffac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b75d7a5-152f-4db9-bf19-5fe279a322e3+10:6134:x1877696158112000:12345-192.168.206.46@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790710741.184891:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8ffac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b75d7a5-152f-4db9-bf19-5fe279a322e3+10:6134:x1877696158112000:12345-192.168.206.46@tcp:502:llog_process_th.0 Request processed in 241us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710741.184898:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 176 00010000:00010000:0.0:1790710741.514225:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1790710741.575847:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790710741.575856:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c51ff4b3000 from 4 10000000:01000000:2.0:1790710741.575861:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790710741.575908:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c8046800/0xcbad34b281570d96 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710741.575920:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.146@tcp lock: ffff9c51c8046800/0xcbad34b281570d96 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710741.575932:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.146@tcp lock: ffff9c51c8046800/0xcbad34b281570d96 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710741.575957:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d5ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177013632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790710741.576026:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710741.576091:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c8e73c00 going to sleep for 11 seconds 00000100:00100000:1.0:1790710741.579229:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177013632 00000100:00100000:1.0:1790710741.579245:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177013632 00000100:00100000:1.0:1790710741.579316:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1790710741.579330:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8ff8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+16:5842:x1877696177013632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790710741.579350:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790710741.579368:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c51c6481200/0xcbad34b281570d9d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbad34b281570d96 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710741.579396:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c51c6481200/0xcbad34b281570d9d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbad34b281570d96 expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710741.579408:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c51c6481200/0xcbad34b281570d9d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281570d96 expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710741.579437:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c6481200, rc 0) 00000100:00100000:1.0:1790710741.579536:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8ff8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+17:5842:x1877696177013632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 212us (3510us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710741.579543:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1790710741.579674:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d5ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177013632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790710741.579698:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.146@tcp lock: ffff9c51c8046800/0xcbad34b281570d96 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570d9d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710741.579713:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.146@tcp lock: ffff9c51c8046800/0xcbad34b281570d96 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbad34b281570d9d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710741.579805:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51fef70000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177013760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790710741.579843:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710741.579877:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c5f57f00 going to sleep for 11 seconds 00000100:00100000:3.0:1790710741.579936:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177013760 00000100:00100000:3.0:1790710741.579941:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177013760 00000100:00100000:3.0:1790710741.579975:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1790710741.579986:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8ff9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+17:5842:x1877696177013760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790710741.580244:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8ff9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+17:5842:x1877696177013760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 261us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710741.580251:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1790710741.581178:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51fef70000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177013760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790710741.581222:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51fef70000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177013888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790710741.581269:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710741.581292:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c5f57f00 going to sleep for 11 seconds 00000100:00100000:0.0:1790710741.581308:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177013888 00000100:00100000:0.0:1790710741.581313:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177013888 00000100:00100000:0.0:1790710741.581343:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1790710741.581350:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8ffbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+17:5842:x1877696177013888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790710741.581507:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8ffbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+17:5842:x1877696177013888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 156us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710741.581514:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1790710741.581561:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51fef70000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177013888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790710741.581724:0:8589:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51fef70000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d27fc27-b651-404a-bd8c-b798806fb18a:8589:1877696177014016:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790710741.581759:0:8589:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710741.581777:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177014016 00000100:00100000:0.0:1790710741.581785:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177014016 00000100:00100000:0.0:1790710741.581814:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1790710741.581820:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8ffa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+17:8589:x1877696177014016:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790710741.581947:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8ffa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+17:8589:x1877696177014016:12345-0@lo:502:llog_process_th.0 Request processed in 127us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710741.581954:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1790710741.581980:0:8589:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c5f57e40 going to sleep for 11 seconds 00000100:00100000:0.0:1790710741.581992:0:8589:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51fef70000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d27fc27-b651-404a-bd8c-b798806fb18a:8589:1877696177014016:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790710741.582013:0:8589:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790710741.582022:0:8589:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790710741.582024:0:8589:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1790710741.582031:0:8589:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c51ff4b3000 00000020:00000080:0.0:1790710741.582033:0:8589:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1790710741.582096:0:8589:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51fef70000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d27fc27-b651-404a-bd8c-b798806fb18a:8589:1877696177014144:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790710741.582155:0:8589:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710741.582173:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177014144 00000100:00100000:0.0:1790710741.582176:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177014144 00000100:00100000:0.0:1790710741.582195:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1790710741.582200:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8ffb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+17:8589:x1877696177014144:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790710741.582299:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8ffb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+17:8589:x1877696177014144:12345-0@lo:502:llog_process_th.0 Request processed in 98us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710741.582305:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1790710741.582338:0:8589:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c5f57e40 going to sleep for 11 seconds 00000100:00100000:0.0:1790710741.582350:0:8589:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51fef70000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d27fc27-b651-404a-bd8c-b798806fb18a:8589:1877696177014144:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790710741.582366:0:8589:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790710741.582370:0:8589:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790710741.582376:0:8589:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1790710741.582379:0:8589:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1790710741.582422:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1790710741.582437:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790710741.582446:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c8046800/0xcbad34b281570d96 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570d9d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710741.582457:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.146@tcp lock: ffff9c51c8046800/0xcbad34b281570d96 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570d9d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790710741.582467:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790710741.582469:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c51f444d000 from 4 10000000:01000000:0.0:1790710741.582473:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790710741.582493:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c0031a00/0xcbad34b281570da4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710741.582501:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.146@tcp lock: ffff9c51c0031a00/0xcbad34b281570da4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710741.582511:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.146@tcp lock: ffff9c51c0031a00/0xcbad34b281570da4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710741.582523:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51fef70000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177014272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790710741.582546:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710741.582559:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c80c6a80 going to sleep for 11 seconds 00000100:00100000:0.0:1790710741.582569:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177014272 00000100:00100000:0.0:1790710741.582573:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177014272 00000100:00100000:0.0:1790710741.582589:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1790710741.582594:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8ffa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+17:5842:x1877696177014272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790710741.582602:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790710741.582615:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c51c0030800/0xcbad34b281570dab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbad34b281570da4 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710741.582635:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c51c0030800/0xcbad34b281570dab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbad34b281570da4 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710741.582644:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c51c0030800/0xcbad34b281570dab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281570da4 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710741.582653:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c0030800, rc 0) 00000100:00100000:0.0:1790710741.582680:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8ffa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+18:5842:x1877696177014272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 86us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710741.582686:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1790710741.582714:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51fef70000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177014272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790710741.582725:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.146@tcp lock: ffff9c51c0031a00/0xcbad34b281570da4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570dab expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710741.582733:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.146@tcp lock: ffff9c51c0031a00/0xcbad34b281570da4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbad34b281570dab expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710741.582765:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51fef70000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177014400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790710741.582785:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710741.582809:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c80c6a80 going to sleep for 11 seconds 00000100:00100000:0.0:1790710741.582819:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177014400 00000100:00100000:0.0:1790710741.582822:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177014400 00000100:00100000:0.0:1790710741.582836:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1790710741.582841:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ee72a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+18:5842:x1877696177014400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790710741.583033:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ee72a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+18:5842:x1877696177014400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 190us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710741.583044:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1790710741.583069:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51fef70000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177014400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790710741.583090:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51fef70000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177014528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790710741.583119:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710741.583158:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c80c6a80 going to sleep for 11 seconds 00000100:00100000:0.0:1790710741.583168:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177014528 00000100:00100000:0.0:1790710741.583171:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177014528 00000100:00100000:0.0:1790710741.583186:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1790710741.583192:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ee72a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+18:5842:x1877696177014528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790710741.583294:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ee72a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+18:5842:x1877696177014528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 101us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710741.583300:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1790710741.583332:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51fef70000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177014528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790710741.583495:0:8591:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51fef70000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d27fc27-b651-404a-bd8c-b798806fb18a:8591:1877696177014656:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790710741.583525:0:8591:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710741.583542:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177014656 00000100:00100000:0.0:1790710741.583545:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177014656 00000100:00100000:0.0:1790710741.583560:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1790710741.583566:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c64efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+18:8591:x1877696177014656:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790710741.583668:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c64efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+18:8591:x1877696177014656:12345-0@lo:502:llog_process_th.0 Request processed in 102us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710741.583675:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1790710741.583699:0:8591:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c80c6240 going to sleep for 11 seconds 00000100:00100000:0.0:1790710741.583709:0:8591:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51fef70000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d27fc27-b651-404a-bd8c-b798806fb18a:8591:1877696177014656:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790710741.583731:0:8591:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790710741.583738:0:8591:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790710741.583740:0:8591:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1790710741.583747:0:8591:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c51f444d000 00000020:00000080:0.0:1790710741.583749:0:8591:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1790710741.583813:0:8591:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51fef70000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d27fc27-b651-404a-bd8c-b798806fb18a:8591:1877696177014784:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790710741.583844:0:8591:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710741.583862:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177014784 00000100:00100000:0.0:1790710741.583866:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177014784 00000100:00100000:0.0:1790710741.583883:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1790710741.583888:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c64ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+18:8591:x1877696177014784:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790710741.587375:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c64ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+18:8591:x1877696177014784:12345-0@lo:502:llog_process_th.0 Request processed in 3479us (3523us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710741.587389:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1790710741.587454:0:8591:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c80c6240 going to sleep for 11 seconds 00000100:00100000:0.0:1790710741.587477:0:8591:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51fef70000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d27fc27-b651-404a-bd8c-b798806fb18a:8591:1877696177014784:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790710741.587508:0:8591:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790710741.587516:0:8591:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790710741.587518:0:8591:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1790710741.587523:0:8591:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1790710741.587677:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1790710741.587703:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790710741.587714:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c0031a00/0xcbad34b281570da4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570dab expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710741.587736:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.146@tcp lock: ffff9c51c0031a00/0xcbad34b281570da4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570dab expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790710741.587746:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790710741.587749:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c51c67ea000 from 4 10000000:01000000:3.0:1790710741.587751:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790710741.587782:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c1645200/0xcbad34b281570db2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710741.587790:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.146@tcp lock: ffff9c51c1645200/0xcbad34b281570db2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710741.587810:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.146@tcp lock: ffff9c51c1645200/0xcbad34b281570db2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710741.587831:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f8ce4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177014912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790710741.587870:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710741.587898:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c8dc7d80 going to sleep for 11 seconds 00000100:00100000:0.0:1790710741.587947:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177014912 00000100:00100000:0.0:1790710741.587954:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177014912 00000100:00100000:0.0:1790710741.590963:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1790710741.590983:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c64ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+18:5842:x1877696177014912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790710741.591006:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790710741.591024:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c51c0030000/0xcbad34b281570db9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbad34b281570db2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710741.591062:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c51c0030000/0xcbad34b281570db9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbad34b281570db2 expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710741.591074:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c51c0030000/0xcbad34b281570db9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281570db2 expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710741.591083:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c0030000, rc 0) 00000100:00100000:0.0:1790710741.591177:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c64ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+19:5842:x1877696177014912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 201us (3306us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710741.591185:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1790710741.592441:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f8ce4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177014912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790710741.592467:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.146@tcp lock: ffff9c51c1645200/0xcbad34b281570db2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570db9 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710741.592478:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.146@tcp lock: ffff9c51c1645200/0xcbad34b281570db2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbad34b281570db9 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710741.592554:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51fef70000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177015040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790710741.592603:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710741.592645:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c80c6f00 going to sleep for 11 seconds 00000100:00100000:3.0:1790710741.593979:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177015040 00000100:00100000:3.0:1790710741.593990:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177015040 00000100:00100000:3.0:1790710741.594047:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1790710741.594056:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c64ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+19:5842:x1877696177015040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790710741.594473:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c64ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+19:5842:x1877696177015040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 417us (1869us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710741.594481:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1790710741.594709:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51fef70000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177015040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790710741.594755:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51fef70000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177015168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790710741.594857:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710741.594886:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c80c6f00 going to sleep for 11 seconds 00000100:00100000:3.0:1790710741.595120:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177015168 00000100:00100000:3.0:1790710741.595141:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177015168 00000100:00100000:3.0:1790710741.595170:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1790710741.595183:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c64ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+19:5842:x1877696177015168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790710741.596450:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c64ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+19:5842:x1877696177015168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1260us (1630us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710741.596461:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1790710741.596590:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51fef70000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177015168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790710741.596930:0:8594:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51fef70000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d27fc27-b651-404a-bd8c-b798806fb18a:8594:1877696177015296:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790710741.596970:0:8594:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710741.597006:0:8594:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c80c6f00 going to sleep for 11 seconds 00000100:00100000:3.0:1790710741.597048:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177015296 00000100:00100000:3.0:1790710741.597053:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177015296 00000100:00100000:3.0:1790710741.597089:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1790710741.597096:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c64ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+19:8594:x1877696177015296:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790710741.597527:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c64ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+19:8594:x1877696177015296:12345-0@lo:502:llog_process_th.0 Request processed in 429us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710741.597535:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1790710741.603393:0:8594:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51fef70000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d27fc27-b651-404a-bd8c-b798806fb18a:8594:1877696177015296:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790710741.603434:0:8594:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790710741.603443:0:8594:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790710741.603445:0:8594:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1790710741.603452:0:8594:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c51c67ea000 00000020:00000080:0.0:1790710741.603455:0:8594:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1790710741.603850:0:8594:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51fef70000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d27fc27-b651-404a-bd8c-b798806fb18a:8594:1877696177015424:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790710741.603918:0:8594:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710741.611619:0:8594:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f9f1c540 going to sleep for 11 seconds 00000100:00100000:3.0:1790710741.611846:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177015424 00000100:00100000:3.0:1790710741.611855:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177015424 00000100:00100000:3.0:1790710741.611917:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1790710741.611927:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c64ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+19:8594:x1877696177015424:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790710741.612171:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c64ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+19:8594:x1877696177015424:12345-0@lo:502:llog_process_th.0 Request processed in 245us (8253us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710741.612179:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1790710741.613184:0:8594:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51fef70000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d27fc27-b651-404a-bd8c-b798806fb18a:8594:1877696177015424:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790710741.613220:0:8594:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790710741.613229:0:8594:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790710741.613644:0:8594:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1790710741.613652:0:8594:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1790710741.613843:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1790710741.613862:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790710741.613872:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c1645200/0xcbad34b281570db2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570db9 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710741.613885:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.146@tcp lock: ffff9c51c1645200/0xcbad34b281570db2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570db9 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710742.537348:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790710742.797583:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790710742.797624:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d27fc27-b651-404a-bd8c-b798806fb18a:3310:1877696177015552:0@lo:400:kworker.0 00000100:00100000:2.0:1790710742.797817:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710742.798196:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177015552 00000100:00100000:2.0:1790710742.798204:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177015552 00000100:00100000:2.0:1790710742.798268:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1790710742.798277:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c64e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+19:3310:x1877696177015552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790710742.798370:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c64e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+19:3310:x1877696177015552:12345-0@lo:400:kworker.0 Request processed in 93us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710742.798391:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1790710742.798472:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d27fc27-b651-404a-bd8c-b798806fb18a:3310:1877696177015552:0@lo:400:kworker.0 00000100:00100000:2.0:1790710742.798543:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877696177015680:0@lo:400:kworker.0 00000100:00100000:0.0:1790710742.800237:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51fef71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1877696177015936:0@lo:400:kworker.0 00000100:00100000:1.0:1790710742.800692:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51fef70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1877696177016064:0@lo:400:kworker.0 00000100:00100000:0.0:1790710742.800843:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710742.800877:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790710742.800884:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51fef70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1877696177015808:0@lo:400:kworker.0 00000100:00100000:0.0:1790710742.800944:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710742.800995:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177015808 00000100:00100000:0.0:1790710742.801016:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177015808 00000100:00100000:0.0:1790710742.801091:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790710742.801147:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51fef71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1877696177015808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790710742.801228:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51fef71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1877696177015808:12345-0@lo:400:kworker.0 Request processed in 115us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710742.801235:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790710742.801271:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51fef70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1877696177015808:0@lo:400:kworker.0 00000100:00100000:0.0:1790710742.801307:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177015936 00000100:00100000:0.0:1790710742.801311:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177015936 00000100:00100000:0.0:1790710742.801337:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790710742.801364:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51fef71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1877696177015936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790710742.801401:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51fef71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1877696177015936:12345-0@lo:400:kworker.0 Request processed in 58us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710742.801408:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1790710742.801433:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51fef71c00 x1877696177015936/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790710758 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790710742.801443:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51fef71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1877696177015936:0@lo:400:kworker.0 00000100:00080000:0.0:1790710742.801475:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790710742.801479:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790710742.807873:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710742.807924:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790710742.807937:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51fef70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1877696177016192:0@lo:400:kworker.0 00000100:00100000:1.0:1790710742.807972:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710742.808010:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177016064 00000100:00100000:1.0:1790710742.808017:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177016064 00000100:00100000:1.0:1790710742.808068:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790710742.808077:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c812d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1877696177016064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790710742.808145:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c812d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1877696177016064:12345-0@lo:400:kworker.0 Request processed in 68us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710742.808152:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790710742.808178:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177016192 00000100:00100000:1.0:1790710742.808181:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177016192 00000100:00100000:1.0:1790710742.808206:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790710742.808213:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c812f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1877696177016192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790710742.808244:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c812f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1877696177016192:12345-0@lo:400:kworker.0 Request processed in 31us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710742.808250:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1790710742.808265:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790710742.808269:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1790710742.808610:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51fef70a80 x1877696177016192/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790710758 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790710742.808626:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51fef70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1877696177016192:0@lo:400:kworker.0 00000100:00100000:1.0:1790710742.808736:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51fef70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1877696177016064:0@lo:400:kworker.0 00000100:00100000:2.0:1790710742.809948:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710742.810081:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177015680 00000100:00100000:1.0:1790710742.810088:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177015680 00000100:00100000:1.0:1790710742.810198:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790710742.810206:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1877696177015680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790710742.810269:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1877696177015680:12345-0@lo:400:kworker.0 Request processed in 63us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710742.810276:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790710742.810339:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877696177015680:0@lo:400:kworker.0 00000100:00100000:3.0:1790710743.007217:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710743.007324:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710743.007362:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710743.007479:0:6696:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158112384 00000100:00100000:0.0:1790710743.007479:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158112128 00000100:00100000:1.0:1790710743.007492:0:6696:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158112384 00000100:00100000:0.0:1790710743.007492:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158112128 00000100:00100000:1.0:1790710743.007545:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 15 00000100:00100000:0.0:1790710743.007545:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 193 00000100:00100000:1.0:1790710743.007553:0:6696:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f8ce4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+5:2357:x1877696158112384:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:0.0:1790710743.007554:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c64e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b75d7a5-152f-4db9-bf19-5fe279a322e3+10:2357:x1877696158112128:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:1.0:1790710743.007622:0:6696:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f8ce4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+5:2357:x1877696158112384:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 69us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710743.007629:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 15 00000100:00080000:1.0:1790710743.007649:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790710743.007711:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158112256 00000100:00100000:2.0:1790710743.007721:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158112256 00000100:00100000:2.0:1790710743.007762:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 33 00000100:00100000:2.0:1790710743.007771:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f8ce5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:2357:x1877696158112256:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:1.0:1790710743.012439:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00080000:1.0:1790710743.012903:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790710743.012956:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158112512 00000100:00100000:3.0:1790710743.012966:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158112512 00000100:00100000:3.0:1790710743.013016:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 16 00000100:00100000:3.0:1790710743.013024:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c812ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+5:2357:x1877696158112512:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:3.0:1790710743.013086:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c812ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+5:2357:x1877696158112512:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 63us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710743.013094:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 16 00000100:00080000:1.0:1790710743.013484:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790710743.015773:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c64e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b75d7a5-152f-4db9-bf19-5fe279a322e3+10:2357:x1877696158112128:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 8211us (8557us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710743.015787:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 193 00000100:00100000:2.0:1790710743.015844:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f8ce5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:2357:x1877696158112256:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 8071us (8476us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710743.015854:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 33 00000100:00100000:3.0:1790710743.304737:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790710743.304759:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51fef71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1877696177016320:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790710743.304837:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710743.305199:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177016320 00000100:00100000:0.0:1790710743.305208:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177016320 00000100:00100000:0.0:1790710743.305425:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790710743.305439:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f8ce5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877696177016320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790710743.305476:0:6699:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790710743.305545:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f8ce5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877696177016320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710743.305552:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1790710743.305730:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51fef71c00 x1877696177016320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790710759 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790710743.305749:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51fef71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1877696177016320:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1790710743.560225:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790710743.819111:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1877696177016448:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790710743.819196:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710743.819262:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177016448 00000100:00100000:1.0:1790710743.819276:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177016448 00000100:00100000:1.0:1790710743.819315:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790710743.819323:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c812ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877696177016448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790710743.819355:0:6699:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790710743.819396:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c812ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877696177016448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710743.819403:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1790710743.819443:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51f4d5c380 x1877696177016448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790710759 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790710743.819460:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1877696177016448:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1790710744.588075:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790710745.611488:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790710746.316710:0:8806:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg646-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:1.0:1790710746.631284:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710747.658091:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790710747.911445:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877696177016704:0@lo:400:kworker.0 00000100:00100000:2.0:1790710747.911570:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710747.911622:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1877696177017216:0@lo:400:kworker.0 00000100:00100000:2.0:1790710747.911650:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710747.911695:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1790710747.911715:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d27fc27-b651-404a-bd8c-b798806fb18a:3310:1877696177016576:0@lo:400:kworker.0 00000100:00100000:2.0:1790710747.911746:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710747.911777:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1877696177017088:0@lo:400:kworker.0 00000100:00100000:2.0:1790710747.911798:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710747.911824:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1877696177016832:0@lo:400:kworker.0 00000100:00100000:2.0:1790710747.911846:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710747.911863:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790710747.911868:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177016960:0@lo:400:kworker.0 00000100:00100000:2.0:1790710747.911888:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710747.911922:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177016704 00000100:00100000:2.0:1790710747.911930:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177016704 00000100:00100000:2.0:1790710747.911970:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177017088 00000100:00100000:2.0:1790710747.911973:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177017088 00000100:00100000:2.0:1790710747.912000:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177016832 00000100:00100000:2.0:1790710747.912003:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177016832 00000100:00100000:2.0:1790710747.912021:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790710747.912028:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1877696177016704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790710747.912077:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1877696177016704:12345-0@lo:400:kworker.0 Request processed in 49us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710747.912084:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790710747.912103:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1790710747.912109:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1877696177017088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790710747.912165:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1877696177017088:12345-0@lo:400:kworker.0 Request processed in 56us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710747.912172:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1790710747.912184:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790710747.912190:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1877696177016832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790710747.912232:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1877696177016832:12345-0@lo:400:kworker.0 Request processed in 42us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710747.912238:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790710747.912256:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177017216 00000100:00100000:2.0:1790710747.912260:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177017216 00000100:00100000:2.0:1790710747.912284:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177016960 00000100:00100000:2.0:1790710747.912287:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177016960 00000100:00100000:2.0:1790710747.912300:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790710747.912305:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1877696177017216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790710747.912334:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1877696177017216:12345-0@lo:400:kworker.0 Request processed in 28us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710747.912339:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790710747.912349:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790710747.912354:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1877696177016960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790710747.912380:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1877696177016960:12345-0@lo:400:kworker.0 Request processed in 26us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710747.912386:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790710747.912403:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177016576 00000100:00100000:2.0:1790710747.912406:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177016576 00000100:00100000:2.0:1790710747.912428:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1790710747.912434:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c64e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+19:3310:x1877696177016576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790710747.912463:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c64e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+19:3310:x1877696177016576:12345-0@lo:400:kworker.0 Request processed in 29us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710747.912469:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00010000:00080000:2.0:1790710747.912526:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51f4d5c380 x1877696177016960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790710763 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790710747.912552:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177016960:0@lo:400:kworker.0 00000100:00100000:2.0:1790710747.912565:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1877696177016832:0@lo:400:kworker.0 00000100:00100000:2.0:1790710747.912592:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d27fc27-b651-404a-bd8c-b798806fb18a:3310:1877696177016576:0@lo:400:kworker.0 00000100:00100000:2.0:1790710747.912600:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1877696177017088:0@lo:400:kworker.0 00000100:00100000:2.0:1790710747.912608:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877696177016704:0@lo:400:kworker.0 00010000:00080000:2.0:1790710747.912617:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51f4d5ed80 x1877696177017216/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790710763 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790710747.912625:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1877696177017216:0@lo:400:kworker.0 00000100:00080000:1.0:1790710747.914173:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790710747.914181:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790710747.914184:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790710748.135695:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710748.135866:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710748.135894:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710748.135937:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158112768 00000100:00100000:2.0:1790710748.135948:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158112768 00000100:00100000:3.0:1790710748.135954:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710748.136003:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158113024 00000100:00100000:3.0:1790710748.136008:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158113024 00000100:00100000:2.0:1790710748.136014:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 37 00000100:00100000:2.0:1790710748.136026:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f8ce6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:2359:x1877696158112768:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:3.0:1790710748.136043:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158112896 00000100:00100000:3.0:1790710748.136047:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158112896 00000100:00100000:3.0:1790710748.136074:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 19 00000100:00100000:3.0:1790710748.136081:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f8ce7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+5:2359:x1877696158113024:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:2.0:1790710748.136101:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f8ce6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:2359:x1877696158112768:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 77us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710748.136109:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 37 00000100:00100000:3.0:1790710748.136118:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f8ce7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+5:2359:x1877696158113024:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 36us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710748.136159:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 19 00000100:00100000:3.0:1790710748.136178:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 20 00000100:00100000:3.0:1790710748.136187:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d032ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+5:2358:x1877696158112896:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:3.0:1790710748.136214:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d032ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+5:2358:x1877696158112896:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 30us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710748.136220:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 20 00000100:00080000:2.0:1790710748.136328:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790710748.136333:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790710748.136335:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790710748.140116:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158112640 00000100:00100000:1.0:1790710748.140143:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158112640 00000100:00100000:1.0:1790710748.140226:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 195 00000100:00100000:1.0:1790710748.140236:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c64e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b75d7a5-152f-4db9-bf19-5fe279a322e3+10:2358:x1877696158112640:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:1.0:1790710748.140319:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c64e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b75d7a5-152f-4db9-bf19-5fe279a322e3+10:2358:x1877696158112640:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 84us (4634us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710748.140326:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 195 00000100:00100000:2.0:1790710748.425944:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790710748.425976:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51fef70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1877696177017344:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790710748.426091:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710748.426344:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177017344 00000100:00100000:0.0:1790710748.426363:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177017344 00000100:00100000:0.0:1790710748.426455:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790710748.426469:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877696177017344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790710748.426575:0:6699:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790710748.426646:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877696177017344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 179us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710748.426655:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1790710748.426737:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51fef70000 x1877696177017344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790710764 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790710748.426783:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51fef70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1877696177017344:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1790710748.679922:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790710748.938312:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790710748.938362:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51d032f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177017472:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790710748.938457:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710748.940211:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177017472 00000100:00100000:1.0:1790710748.940226:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177017472 00000100:00100000:1.0:1790710748.940311:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790710748.940320:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d032e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877696177017472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790710748.940749:0:6700:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790710748.940855:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d032e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877696177017472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 535us (2397us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710748.940864:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1790710748.940938:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51d032f480 x1877696177017472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790710764 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790710748.940970:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51d032f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177017472:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1790710749.703306:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790710750.732673:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790710751.753286:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790710752.181319:0:9050:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg646-server.virtnet: executing yml_node 00010000:00010000:1.0:1790710752.778671:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790710753.034827:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c812e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877696177017728:0@lo:400:kworker.0 00000100:00100000:2.0:1790710753.034949:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710753.035032:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790710753.035039:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c812f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d27fc27-b651-404a-bd8c-b798806fb18a:3310:1877696177017600:0@lo:400:kworker.0 00000100:00100000:2.0:1790710753.035069:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710753.035106:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177017728 00000100:00100000:2.0:1790710753.035113:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177017728 00000100:00100000:2.0:1790710753.035196:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1790710753.035341:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1877696177017728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790710753.035397:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1877696177017728:12345-0@lo:400:kworker.0 Request processed in 193us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710753.035404:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1790710753.035450:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c812e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877696177017728:0@lo:400:kworker.0 00000100:00100000:0.0:1790710753.035536:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177017600 00000100:00100000:0.0:1790710753.035540:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177017600 00000100:00100000:0.0:1790710753.035596:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1790710753.035604:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c64e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+19:3310:x1877696177017600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790710753.035642:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c64e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+19:3310:x1877696177017600:12345-0@lo:400:kworker.0 Request processed in 39us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710753.035648:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1790710753.035679:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c812f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d27fc27-b651-404a-bd8c-b798806fb18a:3310:1877696177017600:0@lo:400:kworker.0 00000100:00100000:0.0:1790710753.040687:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790710753.040716:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c812d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1877696177017856:0@lo:400:kworker.0 00000100:00100000:0.0:1790710753.040802:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710753.042432:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51fef73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1877696177017984:0@lo:400:kworker.0 00000100:00100000:0.0:1790710753.042483:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710753.042521:0:6696:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177017984 00000100:00100000:0.0:1790710753.042528:0:6696:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177017984 00000100:00100000:0.0:1790710753.042594:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790710753.042606:0:6696:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51fef71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1877696177017984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790710753.042657:0:6696:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51fef71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1877696177017984:12345-0@lo:400:kworker.0 Request processed in 56us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710753.042665:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1790710753.042685:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790710753.042712:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51fef73b80 x1877696177017984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790710769 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790710753.042725:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51fef73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1877696177017984:0@lo:400:kworker.0 00000100:00100000:0.0:1790710753.042783:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51fef73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1877696177018112:0@lo:400:kworker.0 00000100:00100000:0.0:1790710753.042809:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710753.047539:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51fef72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1877696177018240:0@lo:400:kworker.0 00000100:00100000:0.0:1790710753.047597:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710753.047627:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177018240 00000100:00100000:0.0:1790710753.047634:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177018240 00000100:00100000:0.0:1790710753.047686:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790710753.047697:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51fef70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1877696177018240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790710753.047760:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51fef70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1877696177018240:12345-0@lo:400:kworker.0 Request processed in 67us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710753.047767:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1790710753.047789:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1790710753.047817:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51fef72680 x1877696177018240/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790710769 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790710753.047830:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51fef72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1877696177018240:0@lo:400:kworker.0 00000100:00100000:2.0:1790710753.051713:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177017856 00000100:00100000:2.0:1790710753.051730:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177017856 00000100:00100000:2.0:1790710753.051820:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177018112 00000100:00100000:2.0:1790710753.051824:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177018112 00000100:00100000:2.0:1790710753.051848:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790710753.051858:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51fef70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1877696177017856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790710753.051955:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51fef70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1877696177017856:12345-0@lo:400:kworker.0 Request processed in 98us (11152us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710753.051962:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790710753.051979:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790710753.051994:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51fef73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1877696177018112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790710753.052030:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51fef73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1877696177018112:12345-0@lo:400:kworker.0 Request processed in 37us (9221us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710753.052036:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790710753.052084:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c812d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1877696177017856:0@lo:400:kworker.0 00000100:00100000:2.0:1790710753.052118:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51fef73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1877696177018112:0@lo:400:kworker.0 00000100:00080000:0.0:1790710753.055013:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790710753.253622:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710753.253666:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710753.253729:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158113280 00000100:00100000:3.0:1790710753.253750:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158113280 00000100:00100000:3.0:1790710753.253816:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 41 00000100:00100000:3.0:1790710753.253825:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51fef72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:2357:x1877696158113280:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:3.0:1790710753.253892:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51fef72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:2357:x1877696158113280:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 68us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710753.253899:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 41 00000100:00100000:2.0:1790710753.253966:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158113152 00000100:00100000:2.0:1790710753.253971:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158113152 00000100:00100000:2.0:1790710753.254006:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 197 00000100:00100000:2.0:1790710753.254014:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c64e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b75d7a5-152f-4db9-bf19-5fe279a322e3+10:2357:x1877696158113152:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:2.0:1790710753.254044:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c64e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b75d7a5-152f-4db9-bf19-5fe279a322e3+10:2357:x1877696158113152:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 32us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710753.254049:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 197 00000100:00080000:0.0:1790710753.256240:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790710753.271796:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710753.271833:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710753.271858:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158113408 00000100:00100000:1.0:1790710753.271867:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158113408 00000100:00100000:1.0:1790710753.271916:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158113536 00000100:00100000:1.0:1790710753.271919:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158113536 00000100:00100000:1.0:1790710753.271934:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 10 00000100:00100000:1.0:1790710753.271942:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c812d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+5:2355:x1877696158113408:12345-192.168.206.46@tcp:9:kworker.0 00000020:00000080:1.0:1790710753.271978:0:6697:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcbad34b281570cf5 00000100:00080000:1.0:1790710753.271986:0:6697:0:(import.c:65:import_set_state_nolock()) ffff9c51f947a000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790710753.272022:0:6697:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1790710753.272376:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c812d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+2:2355:x1877696158113408:12345-192.168.206.46@tcp:9:kworker.0 Request processed in 432us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710753.272384:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 10 00000100:00100000:1.0:1790710753.272401:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 11 00000100:00100000:1.0:1790710753.272408:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c812f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+5:2355:x1877696158113536:12345-192.168.206.46@tcp:9:kworker.0 00000020:00000080:1.0:1790710753.272421:0:6697:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcbad34b281570cfc 00000100:00080000:1.0:1790710753.272427:0:6697:0:(import.c:65:import_set_state_nolock()) ffff9c51fbac5800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790710753.272451:0:6697:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1790710753.272640:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c812f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+2:2355:x1877696158113536:12345-192.168.206.46@tcp:9:kworker.0 Request processed in 232us (805us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710753.272647:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 11 00000100:00080000:1.0:1790710753.272666:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790710753.272670:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1790710753.272728:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790710753.272842:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790710753.543588:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51fef71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177018368:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790710753.543655:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710753.543884:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177018368 00000100:00100000:0.0:1790710753.543892:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177018368 00000100:00100000:0.0:1790710753.543942:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790710753.543951:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d032f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877696177018368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790710753.543984:0:6699:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790710753.544034:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d032f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877696177018368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710753.544041:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1790710753.544305:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51fef71c00 x1877696177018368/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790710769 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790710753.544323:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51fef71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177018368:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1790710753.801344:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790710754.055430:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790710754.055453:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51d032f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177018496:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790710754.055536:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710754.055716:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177018496 00000100:00100000:1.0:1790710754.055724:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177018496 00000100:00100000:1.0:1790710754.055782:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1790710754.055791:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51fef70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877696177018496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790710754.055834:0:6699:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790710754.055889:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51fef70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877696177018496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710754.055895:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1790710754.056042:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51d032f800 x1877696177018496/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790710770 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790710754.056060:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51d032f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177018496:0@lo:13:osp-pre-0-0.0 00000001:00100000:1.0:1790710754.621347:0:6720:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0ec73bd1-726e-4dc0-8edd-807d3f973d65 00000020:00000080:1.0:1790710754.621355:0:6720:0:(genops.c:885:class_export_put()) final put ffff9c51f4449000/0ec73bd1-726e-4dc0-8edd-807d3f973d65 00000020:00000080:2.0:1790710754.621464:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c51f4449000/0ec73bd1-726e-4dc0-8edd-807d3f973d65 for lustre-OST0000 00000020:00000080:2.0:1790710754.621516:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c51f947a000 for lustre-OST0000 00010000:00010000:1.0:1790710754.823301:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790710755.847268:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790710756.008664:0:9242:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.59.2 00010000:00010000:1.0:1790710756.871274:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1790710757.170747:0:7643:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0ec73bd1-726e-4dc0-8edd-807d3f973d65 00000020:00000080:1.0:1790710757.170755:0:7643:0:(genops.c:885:class_export_put()) final put ffff9c51f947b000/0ec73bd1-726e-4dc0-8edd-807d3f973d65 00000020:00000080:3.0:1790710757.170914:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c51f947b000/0ec73bd1-726e-4dc0-8edd-807d3f973d65 for lustre-OST0001 00000020:00000080:3.0:1790710757.170962:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c51fbac5800 for lustre-OST0001 00010000:00010000:1.0:1790710757.895281:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790710757.980697:0:9340:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.59.2 00000100:00100000:1.0:1790710758.151449:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51d032c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1877696177018880:0@lo:400:kworker.0 00000100:00100000:1.0:1790710758.151514:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710758.151589:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790710758.151608:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51d032dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177019008:0@lo:400:kworker.0 00000100:00100000:1.0:1790710758.151650:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710758.151691:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177019008 00000100:00100000:1.0:1790710758.151699:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177019008 00000100:00100000:1.0:1790710758.151767:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790710758.151776:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9ca0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1877696177019008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790710758.151833:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9ca0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1877696177019008:12345-0@lo:400:kworker.0 Request processed in 59us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710758.151840:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1790710758.151937:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790710758.151979:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51d032dc00 x1877696177019008/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790710774 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790710758.151994:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51d032dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177019008:0@lo:400:kworker.0 00000100:00100000:0.0:1790710758.152077:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51d032ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877696177018752:0@lo:400:kworker.0 00000100:00100000:0.0:1790710758.152110:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710758.152164:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51d032df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1877696177019264:0@lo:400:kworker.0 00000100:00100000:0.0:1790710758.152187:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710758.152211:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1790710758.152217:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51d032e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d27fc27-b651-404a-bd8c-b798806fb18a:3310:1877696177018624:0@lo:400:kworker.0 00000100:00100000:0.0:1790710758.152250:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710758.152270:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51d032c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1877696177019136:0@lo:400:kworker.0 00000100:00100000:0.0:1790710758.152290:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710758.152325:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177019264 00000100:00100000:0.0:1790710758.152330:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177019264 00000100:00100000:0.0:1790710758.152359:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790710758.152366:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51fef71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1877696177019264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790710758.152404:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51fef71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1877696177019264:12345-0@lo:400:kworker.0 Request processed in 38us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710758.152410:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790710758.152426:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177018880 00000100:00100000:0.0:1790710758.152429:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177018880 00000100:00100000:0.0:1790710758.152450:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177018752 00000100:00100000:0.0:1790710758.152452:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177018752 00000100:00100000:0.0:1790710758.152464:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177019136 00000100:00100000:0.0:1790710758.152466:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177019136 00000100:00100000:0.0:1790710758.152480:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1790710758.152486:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c812e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1877696177018880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790710758.152648:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c812e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1877696177018880:12345-0@lo:400:kworker.0 Request processed in 161us (1133us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710758.152655:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1790710758.152668:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1790710758.152674:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51fef70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1877696177018752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790710758.152702:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51fef70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1877696177018752:12345-0@lo:400:kworker.0 Request processed in 29us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710758.152709:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1790710758.152732:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1790710758.152738:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51fef73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1877696177019136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790710758.152843:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51fef73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1877696177019136:12345-0@lo:400:kworker.0 Request processed in 28us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710758.152859:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1790710758.152892:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51d032c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1877696177019136:0@lo:400:kworker.0 00000100:00100000:0.0:1790710758.152902:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51d032ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877696177018752:0@lo:400:kworker.0 00010000:00080000:0.0:1790710758.152913:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51d032df80 x1877696177019264/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790710774 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790710758.152923:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51d032df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1877696177019264:0@lo:400:kworker.0 00000100:00080000:1.0:1790710758.152987:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790710758.152991:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790710758.153017:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51d032c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1877696177018880:0@lo:400:kworker.0 00000100:00100000:2.0:1790710758.153171:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177018624 00000100:00100000:2.0:1790710758.153177:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177018624 00000100:00100000:2.0:1790710758.153207:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1790710758.153213:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c64e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+19:3310:x1877696177018624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790710758.153269:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c64e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+19:3310:x1877696177018624:12345-0@lo:400:kworker.0 Request processed in 56us (1017us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710758.153275:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1790710758.153354:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51d032e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d27fc27-b651-404a-bd8c-b798806fb18a:3310:1877696177018624:0@lo:400:kworker.0 00000100:00100000:2.0:1790710758.369878:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710758.369941:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710758.370000:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158113664 00000100:00100000:2.0:1790710758.370014:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158113664 00000100:00100000:2.0:1790710758.370079:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 199 00000100:00100000:2.0:1790710758.370103:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c80fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b75d7a5-152f-4db9-bf19-5fe279a322e3+10:2356:x1877696158113664:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:3.0:1790710758.370488:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158113792 00000100:00100000:3.0:1790710758.370494:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158113792 00000100:00100000:3.0:1790710758.370569:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 45 00000100:00100000:3.0:1790710758.370578:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:2356:x1877696158113792:12345-192.168.206.46@tcp:400:kworker.0 00000100:00080000:1.0:1790710758.371520:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790710758.371665:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:2356:x1877696158113792:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 1029us (1744us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710758.371678:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 45 00000100:00100000:2.0:1790710758.372976:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c80fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b75d7a5-152f-4db9-bf19-5fe279a322e3+10:2356:x1877696158113664:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 2861us (3020us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710758.372991:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 199 00000100:00100000:0.0:1790710758.664213:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790710758.664235:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f978d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1877696177019392:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790710758.664304:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710758.664371:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177019392 00000100:00100000:0.0:1790710758.664379:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177019392 00000100:00100000:0.0:1790710758.664430:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790710758.664439:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f978c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877696177019392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790710758.664473:0:6699:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790710758.664517:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f978c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877696177019392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710758.664524:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1790710758.664569:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51f978d880 x1877696177019392/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790710774 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790710758.664585:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f978d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1877696177019392:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1790710758.919249:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790710759.175358:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51d032e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1877696177019520:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790710759.175436:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710759.175603:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177019520 00000100:00100000:1.0:1790710759.175611:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177019520 00000100:00100000:1.0:1790710759.175667:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790710759.175677:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f978d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877696177019520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790710759.175725:0:6699:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790710759.175785:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f978d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877696177019520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710759.175793:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1790710759.176013:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51d032e300 x1877696177019520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790710775 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790710759.176034:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51d032e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1877696177019520:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1790710759.943301:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1790710760.235027:0:9438:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.59.2 00010000:00010000:1.0:1790710760.968171:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790710761.836911:0:9486:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Tue Sep 29 15:39:20 EDT 2026 00010000:00010000:1.0:1790710761.994237:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790710763.015293:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790710763.271552:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9ca2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d27fc27-b651-404a-bd8c-b798806fb18a:3309:1877696177019648:0@lo:400:kworker.0 00000100:00100000:0.0:1790710763.271650:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710763.271735:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177019648 00000100:00100000:3.0:1790710763.271745:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177019648 00000100:00100000:3.0:1790710763.271810:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1790710763.271826:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c80fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+19:3309:x1877696177019648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790710763.273272:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9ca3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877696177019776:0@lo:400:kworker.0 00000100:00100000:1.0:1790710763.273356:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710763.273390:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9ca2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1877696177020288:0@lo:400:kworker.0 00000100:00100000:1.0:1790710763.273415:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710763.273436:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790710763.273441:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9ca2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1877696177020160:0@lo:400:kworker.0 00000100:00100000:1.0:1790710763.273460:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710763.273486:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9ca2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1877696177019904:0@lo:400:kworker.0 00000100:00100000:1.0:1790710763.273797:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710763.273825:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790710763.273831:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9ca3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177020032:0@lo:400:kworker.0 00000100:00100000:1.0:1790710763.273858:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710763.273899:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177019776 00000100:00100000:1.0:1790710763.273907:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177019776 00000100:00100000:1.0:1790710763.273954:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177020160 00000100:00100000:1.0:1790710763.273957:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177020160 00000100:00100000:1.0:1790710763.273979:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177019904 00000100:00100000:1.0:1790710763.273981:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177019904 00000100:00100000:1.0:1790710763.273995:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1790710763.274004:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9ca0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1877696177019776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790710763.274063:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9ca0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1877696177019776:12345-0@lo:400:kworker.0 Request processed in 59us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710763.274070:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1790710763.274087:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1790710763.274093:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9ca0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1877696177020160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790710763.274164:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9ca0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1877696177020160:12345-0@lo:400:kworker.0 Request processed in 71us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710763.274170:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1790710763.274181:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1790710763.274187:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9ca1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1877696177019904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790710763.274215:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9ca1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1877696177019904:12345-0@lo:400:kworker.0 Request processed in 28us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710763.274220:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1790710763.274238:0:6696:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177020288 00000100:00100000:1.0:1790710763.274241:0:6696:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177020288 00000100:00100000:1.0:1790710763.274276:0:6696:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177020032 00000100:00100000:1.0:1790710763.274279:0:6696:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177020032 00000100:00100000:1.0:1790710763.274293:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790710763.274299:0:6696:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9ca1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1877696177020288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790710763.274345:0:6696:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9ca1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1877696177020288:12345-0@lo:400:kworker.0 Request processed in 45us (928us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710763.274351:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790710763.274364:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790710763.274369:0:6696:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9ca0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1877696177020032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790710763.274395:0:6696:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9ca0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1877696177020032:12345-0@lo:400:kworker.0 Request processed in 26us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710763.274400:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1790710763.274433:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790710763.274438:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790710763.274440:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790710763.274479:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9ca2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1877696177020160:0@lo:400:kworker.0 00000100:00100000:1.0:1790710763.274790:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9ca3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877696177019776:0@lo:400:kworker.0 00010000:00080000:1.0:1790710763.274813:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51f9ca2a00 x1877696177020288/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790710779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790710763.274826:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9ca2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1877696177020288:0@lo:400:kworker.0 00010000:00080000:1.0:1790710763.274870:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51f9ca3800 x1877696177020032/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790710779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790710763.274879:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9ca3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177020032:0@lo:400:kworker.0 00000100:00100000:1.0:1790710763.274889:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9ca2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1877696177019904:0@lo:400:kworker.0 00000100:00100000:3.0:1790710763.275849:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c80fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+19:3309:x1877696177019648:12345-0@lo:400:kworker.0 Request processed in 4021us (4189us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710763.275865:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1790710763.278481:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9ca2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d27fc27-b651-404a-bd8c-b798806fb18a:3309:1877696177019648:0@lo:400:kworker.0 00000100:00100000:1.0:1790710763.488846:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710763.488912:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710763.490223:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158113920 00000100:00100000:1.0:1790710763.490237:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158113920 00000100:00100000:1.0:1790710763.490310:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 201 00000100:00100000:1.0:1790710763.490319:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c80fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b75d7a5-152f-4db9-bf19-5fe279a322e3+10:2356:x1877696158113920:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:3.0:1790710763.490462:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158114048 00000100:00100000:1.0:1790710763.490472:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c80fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b75d7a5-152f-4db9-bf19-5fe279a322e3+10:2356:x1877696158113920:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 150us (1555us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710763.490478:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158114048 00000100:00100000:1.0:1790710763.490484:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 201 00000100:00100000:3.0:1790710763.490571:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 49 00000100:00100000:3.0:1790710763.490601:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9ca2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:2356:x1877696158114048:12345-192.168.206.46@tcp:400:kworker.0 00000100:00080000:1.0:1790710763.490638:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790710763.490704:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9ca2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:2356:x1877696158114048:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 104us (1870us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710763.490714:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 49 00000100:00100000:1.0:1790710763.784257:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177020416:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790710763.784321:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710763.784865:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177020416 00000100:00100000:2.0:1790710763.784873:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177020416 00000100:00100000:2.0:1790710763.784929:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790710763.784941:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9ca3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877696177020416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790710763.784977:0:6699:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790710763.785035:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9ca3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877696177020416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710763.785042:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1790710763.785189:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51f4d5e300 x1877696177020416/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790710779 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790710763.785208:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177020416:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1790710764.041275:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790710764.295582:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790710764.295614:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51d032ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177020544:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790710764.295719:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710764.296171:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177020544 00000100:00100000:1.0:1790710764.296182:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177020544 00000100:00100000:0.0:1790710764.297614:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790710764.297646:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877696177020544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790710764.297711:0:6700:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790710764.297816:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877696177020544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 187us (2096us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710764.297823:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1790710764.297925:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51d032ce00 x1877696177020544/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790710780 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790710764.297952:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51d032ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177020544:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1790710765.063522:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710766.092259:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790710767.113223:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790710768.135541:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790710768.391884:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790710768.394472:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51d032d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877696177020800:0@lo:400:kworker.0 00000100:00100000:1.0:1790710768.395316:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710768.395404:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51d032fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d27fc27-b651-404a-bd8c-b798806fb18a:3310:1877696177020672:0@lo:400:kworker.0 00000100:00100000:1.0:1790710768.395445:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710768.395498:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177020672 00000100:00100000:1.0:1790710768.395507:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177020672 00000100:00100000:1.0:1790710768.395575:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1790710768.395584:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c80fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+19:3310:x1877696177020672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790710768.395653:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c80fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+19:3310:x1877696177020672:12345-0@lo:400:kworker.0 Request processed in 69us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710768.395672:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1790710768.395739:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51d032fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d27fc27-b651-404a-bd8c-b798806fb18a:3310:1877696177020672:0@lo:400:kworker.0 00000100:00100000:0.0:1790710768.397122:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177020800 00000100:00100000:0.0:1790710768.397163:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177020800 00000100:00100000:0.0:1790710768.397324:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1790710768.397338:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9ca2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1877696177020800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790710768.397444:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9ca2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1877696177020800:12345-0@lo:400:kworker.0 Request processed in 110us (2561us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710768.397451:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1790710768.397775:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51d032d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877696177020800:0@lo:400:kworker.0 00000100:00100000:2.0:1790710768.399790:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1877696177021184:0@lo:400:kworker.0 00000100:00100000:2.0:1790710768.399892:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710768.399980:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790710768.399987:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1877696177021312:0@lo:400:kworker.0 00000100:00100000:2.0:1790710768.400018:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710768.400099:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1877696177020928:0@lo:400:kworker.0 00000100:00100000:0.0:1790710768.400167:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710768.400188:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790710768.400194:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177021056:0@lo:400:kworker.0 00000100:00100000:0.0:1790710768.400216:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710768.400268:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177021312 00000100:00100000:0.0:1790710768.400288:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177021312 00000100:00100000:0.0:1790710768.400355:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177021056 00000100:00100000:0.0:1790710768.400358:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177021056 00000100:00100000:0.0:1790710768.400391:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790710768.400407:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1877696177021312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790710768.400437:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177021184 00000100:00100000:1.0:1790710768.400445:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177021184 00000100:00100000:0.0:1790710768.400479:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1877696177021312:12345-0@lo:400:kworker.0 Request processed in 78us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710768.400483:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177020928 00000100:00100000:1.0:1790710768.400487:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177020928 00000100:00100000:0.0:1790710768.400489:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790710768.400528:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790710768.400538:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f978f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1877696177021056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790710768.400546:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1790710768.400557:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1877696177021184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790710768.400893:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1790710768.400904:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f978ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1877696177020928:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1790710768.402790:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790710768.402804:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790710768.402808:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1790710768.402875:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51f4d60000 x1877696177021312/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790710784 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790710768.402896:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1877696177021312:0@lo:400:kworker.0 00000100:00100000:0.0:1790710768.406399:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f978f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1877696177021056:12345-0@lo:400:kworker.0 Request processed in 5848us (6165us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710768.406416:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:0.0:1790710768.406531:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51f4d5ca80 x1877696177021056/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790710784 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790710768.406548:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177021056:0@lo:400:kworker.0 00000100:00100000:0.0:1790710768.407225:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1877696177021184:0@lo:400:kworker.0 00000100:00100000:2.0:1790710768.407459:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f978ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1877696177020928:12345-0@lo:400:kworker.0 Request processed in 6555us (7289us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710768.407471:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1790710768.408116:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1877696177020928:0@lo:400:kworker.0 00000100:00100000:1.0:1790710768.409329:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1877696177021184:12345-0@lo:400:kworker.0 Request processed in 8763us (9425us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710768.409413:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1790710768.609349:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710768.610281:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710768.610332:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158114304 00000100:00100000:1.0:1790710768.610345:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158114304 00000100:00100000:1.0:1790710768.610425:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 53 00000100:00100000:1.0:1790710768.610437:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9ca3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:2357:x1877696158114304:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:1.0:1790710768.610537:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9ca3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:2357:x1877696158114304:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 102us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710768.610546:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 53 00000100:00080000:1.0:1790710768.610574:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790710768.611408:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158114176 00000100:00100000:2.0:1790710768.611418:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158114176 00000100:00100000:2.0:1790710768.613033:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 203 00000100:00100000:2.0:1790710768.613057:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c80f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b75d7a5-152f-4db9-bf19-5fe279a322e3+10:2357:x1877696158114176:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:2.0:1790710768.613189:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c80f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b75d7a5-152f-4db9-bf19-5fe279a322e3+10:2357:x1877696158114176:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 141us (3853us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710768.613197:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 203 00000100:00100000:2.0:1790710768.903358:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790710768.903380:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1877696177021440:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790710768.903452:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710768.903753:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177021440 00000100:00100000:2.0:1790710768.903761:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177021440 00000100:00100000:2.0:1790710768.903819:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790710768.903828:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877696177021440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790710768.903864:0:6699:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790710768.904001:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877696177021440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 172us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710768.904008:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1790710768.905712:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51f4d60700 x1877696177021440/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790710784 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790710768.905737:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1877696177021440:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1790710769.159541:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790710769.418483:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790710769.418516:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51d032ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177021568:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790710769.418586:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710769.419611:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177021568 00000100:00100000:3.0:1790710769.419622:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177021568 00000100:00100000:3.0:1790710769.419695:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790710769.419705:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9ca2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877696177021568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790710769.419743:0:6700:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790710769.419814:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9ca2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877696177021568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (1227us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710769.419822:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1790710769.420089:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51d032ca80 x1877696177021568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790710785 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790710769.420106:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51d032ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177021568:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1790710770.184773:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790710771.208866:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710772.233155:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790710773.257034:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790710773.511837:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f978e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d27fc27-b651-404a-bd8c-b798806fb18a:3309:1877696177021696:0@lo:400:kworker.0 00000100:00100000:3.0:1790710773.511938:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710773.513874:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790710773.513899:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f978f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877696177021824:0@lo:400:kworker.0 00000100:00100000:3.0:1790710773.514001:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710773.514165:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177021696 00000100:00100000:2.0:1790710773.514177:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177021696 00000100:00100000:2.0:1790710773.514239:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1790710773.514250:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c80f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+19:3309:x1877696177021696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790710773.514324:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c80f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+19:3309:x1877696177021696:12345-0@lo:400:kworker.0 Request processed in 75us (2384us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710773.514332:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1790710773.514391:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f978e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d27fc27-b651-404a-bd8c-b798806fb18a:3309:1877696177021696:0@lo:400:kworker.0 00000100:00100000:1.0:1790710773.518181:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177021824 00000100:00100000:1.0:1790710773.518198:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177021824 00000100:00100000:1.0:1790710773.518267:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1790710773.518284:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d032f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877696177021824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790710773.518894:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790710773.518913:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f978e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1877696177021952:0@lo:400:kworker.0 00000100:00100000:0.0:1790710773.522421:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710773.523118:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d032f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877696177021824:12345-0@lo:400:kworker.0 Request processed in 4233us (8515us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710773.523162:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1790710773.523387:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f978c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1877696177022080:0@lo:400:kworker.0 00000100:00100000:0.0:1790710773.523449:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710773.523808:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f978c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1877696177022208:0@lo:400:kworker.0 00000100:00100000:0.0:1790710773.523845:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710773.524882:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177021952 00000100:00100000:1.0:1790710773.524895:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177021952 00000100:00100000:1.0:1790710773.524970:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1790710773.524982:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f978ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1877696177021952:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1790710773.527266:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790710773.527565:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f978ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1877696177021952:12345-0@lo:400:kworker.0 Request processed in 2364us (4931us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710773.527582:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1790710773.527688:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f978e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1877696177021952:0@lo:400:kworker.0 00000100:00100000:1.0:1790710773.527726:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f978df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1877696177022336:0@lo:400:kworker.0 00000100:00100000:1.0:1790710773.527788:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710773.530228:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f978f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877696177021824:0@lo:400:kworker.0 00000100:00100000:3.0:1790710773.530261:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177022208 00000100:00100000:3.0:1790710773.530273:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177022208 00000100:00100000:3.0:1790710773.530365:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1790710773.530375:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f978ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1877696177022208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790710773.530463:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f978ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1877696177022208:12345-0@lo:400:kworker.0 Request processed in 90us (6617us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710773.530471:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:3.0:1790710773.531195:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790710773.532051:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f978c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1877696177022208:0@lo:400:kworker.0 00000100:00100000:2.0:1790710773.534542:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177022080 00000100:00100000:2.0:1790710773.534565:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177022080 00000100:00080000:2.0:1790710773.534616:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790710773.534690:0:6696:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177022336 00000100:00100000:2.0:1790710773.534694:0:6696:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177022336 00000100:00100000:2.0:1790710773.534722:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790710773.534732:0:6696:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f978dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1877696177022080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790710773.534853:0:6696:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f978dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1877696177022080:12345-0@lo:400:kworker.0 Request processed in 123us (11404us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710773.534860:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790710773.535037:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790710773.535047:0:6696:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9ca3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1877696177022336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790710773.535091:0:6696:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9ca3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1877696177022336:12345-0@lo:400:kworker.0 Request processed in 47us (7303us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710773.535096:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1790710773.535161:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51f978c000 x1877696177022080/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790710789 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790710773.535195:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f978c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1877696177022080:0@lo:400:kworker.0 00000100:00080000:2.0:1790710773.535223:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1790710773.535301:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51f978df80 x1877696177022336/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790710789 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790710773.535313:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f978df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1877696177022336:0@lo:400:kworker.0 00000100:00100000:0.0:1790710773.744706:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710773.744822:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710773.744878:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158114560 00000100:00100000:0.0:1790710773.744889:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158114560 00000100:00100000:0.0:1790710773.744966:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 57 00000100:00100000:0.0:1790710773.744976:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f978c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:2357:x1877696158114560:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:0.0:1790710773.745069:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f978c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:2357:x1877696158114560:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 94us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710773.745077:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 57 00000100:00080000:0.0:1790710773.745104:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790710773.746895:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158114432 00000100:00100000:2.0:1790710773.746908:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158114432 00000100:00100000:2.0:1790710773.746978:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 205 00000100:00100000:2.0:1790710773.746990:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c80fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b75d7a5-152f-4db9-bf19-5fe279a322e3+10:2357:x1877696158114432:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:2.0:1790710773.747079:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c80fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b75d7a5-152f-4db9-bf19-5fe279a322e3+10:2357:x1877696158114432:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 91us (2387us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710773.747087:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 205 00000001:02000400:1.0:1790710773.975112:0:10116:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 15:39:32 (1790710772) === 00000100:00100000:3.0:1790710774.024669:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790710774.024699:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51d032d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1877696177022464:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790710774.024781:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710774.024854:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177022464 00000100:00100000:3.0:1790710774.024863:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177022464 00000100:00100000:3.0:1790710774.024921:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790710774.024930:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d032d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877696177022464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790710774.026938:0:6700:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790710774.027051:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d032d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877696177022464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2116us (2264us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710774.027062:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1790710774.027171:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51d032d180 x1877696177022464/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790710790 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790710774.027198:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51d032d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1877696177022464:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1790710774.279335:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790710774.417895:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710774.418206:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158114688 00000100:00100000:3.0:1790710774.418218:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158114688 00000100:00100000:3.0:1790710774.418284:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 206 00000100:00100000:3.0:1790710774.418294:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c80f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b75d7a5-152f-4db9-bf19-5fe279a322e3+10:8111:x1877696158114688:12345-192.168.206.46@tcp:101:mount.lustre.0 00010000:00010000:3.0:1790710774.418335:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790710774.418358:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c51c1644e00/0xcbad34b281570dc0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x566877b057000367 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710774.418395:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c51c1644e00/0xcbad34b281570dc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000367 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710774.418408:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c51c1644e00/0xcbad34b281570dc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000367 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710774.418419:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c1644e00, rc 0) 00000100:00100000:3.0:1790710774.418488:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c80f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b75d7a5-152f-4db9-bf19-5fe279a322e3+11:8111:x1877696158114688:12345-192.168.206.46@tcp:101:mount.lustre.0 Request processed in 195us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710774.418496:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 206 00000100:00100000:0.0:1790710774.432466:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710774.432729:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158114816 00000100:00100000:2.0:1790710774.432741:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158114816 00000100:00100000:2.0:1790710774.432817:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 207 00000100:00100000:2.0:1790710774.432829:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c80f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b75d7a5-152f-4db9-bf19-5fe279a322e3+11:8111:x1877696158114816:12345-192.168.206.46@tcp:501:mount.lustre.0 00000100:00100000:2.0:1790710774.438769:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c80f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b75d7a5-152f-4db9-bf19-5fe279a322e3+11:8111:x1877696158114816:12345-192.168.206.46@tcp:501:mount.lustre.0 Request processed in 4125us (4501us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710774.438791:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 207 00000100:00100000:0.0:1790710774.444431:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710774.444783:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158114944 00000100:00100000:2.0:1790710774.444796:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158114944 00000100:00100000:2.0:1790710774.444908:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 208 00000100:00100000:2.0:1790710774.444920:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c80fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b75d7a5-152f-4db9-bf19-5fe279a322e3+11:8111:x1877696158114944:12345-192.168.206.46@tcp:503:mount.lustre.0 00000100:00100000:2.0:1790710774.445232:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c80fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b75d7a5-152f-4db9-bf19-5fe279a322e3+11:8111:x1877696158114944:12345-192.168.206.46@tcp:503:mount.lustre.0 Request processed in 313us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710774.445242:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 208 00000100:00100000:0.0:1790710774.451441:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710774.451625:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158115072 00000100:00100000:2.0:1790710774.451659:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158115072 00000100:00100000:2.0:1790710774.451730:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 209 00000100:00100000:2.0:1790710774.451742:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c80f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b75d7a5-152f-4db9-bf19-5fe279a322e3+11:8115:x1877696158115072:12345-192.168.206.46@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790710774.452768:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c80f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b75d7a5-152f-4db9-bf19-5fe279a322e3+11:8115:x1877696158115072:12345-192.168.206.46@tcp:502:llog_process_th.0 Request processed in 1022us (1512us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710774.452780:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 209 00000100:00100000:0.0:1790710774.470449:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710774.470589:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158115200 00000100:00100000:2.0:1790710774.470603:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158115200 00000100:00100000:2.0:1790710774.470683:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 210 00000100:00100000:2.0:1790710774.470694:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c80f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b75d7a5-152f-4db9-bf19-5fe279a322e3+11:8115:x1877696158115200:12345-192.168.206.46@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790710774.471050:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c80f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b75d7a5-152f-4db9-bf19-5fe279a322e3+11:8115:x1877696158115200:12345-192.168.206.46@tcp:502:llog_process_th.0 Request processed in 355us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710774.471060:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 210 00000100:00100000:1.0:1790710774.481270:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710774.481465:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158115328 00000100:00100000:3.0:1790710774.481491:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158115328 00000100:00100000:3.0:1790710774.481565:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 211 00000100:00100000:3.0:1790710774.481576:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c80fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b75d7a5-152f-4db9-bf19-5fe279a322e3+11:8111:x1877696158115328:12345-192.168.206.46@tcp:101:mount.lustre.0 00010000:00010000:3.0:1790710774.481599:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790710774.481622:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c51c1645a00/0xcbad34b281570dc7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x566877b057000391 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710774.481669:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c51c1645a00/0xcbad34b281570dc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000391 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710774.481682:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c51c1645a00/0xcbad34b281570dc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000391 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710774.481714:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c1645a00, rc 0) 00000100:00100000:3.0:1790710774.481947:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c80fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b75d7a5-152f-4db9-bf19-5fe279a322e3+12:8111:x1877696158115328:12345-192.168.206.46@tcp:101:mount.lustre.0 Request processed in 371us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710774.481955:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 211 00000100:00100000:1.0:1790710774.489196:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710774.489550:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158115456 00000100:00100000:0.0:1790710774.489564:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158115456 00000100:00100000:0.0:1790710774.489684:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 212 00000100:00100000:0.0:1790710774.489697:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c80fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b75d7a5-152f-4db9-bf19-5fe279a322e3+12:8111:x1877696158115456:12345-192.168.206.46@tcp:256:mount.lustre.0 20000000:01000000:0.0:1790710774.489730:0:5840:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1790710774.489760:0:5840:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1790710774.489764:0:5840:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1790710774.489768:0:5840:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1790710774.489770:0:5840:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1790710774.492907:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c80fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b75d7a5-152f-4db9-bf19-5fe279a322e3+12:8111:x1877696158115456:12345-192.168.206.46@tcp:256:mount.lustre.0 Request processed in 3197us (3708us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710774.492926:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 212 00000100:00100000:1.0:1790710774.496246:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710774.496765:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158115584 00000100:00100000:3.0:1790710774.496897:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158115584 00000100:00100000:3.0:1790710774.497029:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 213 00000100:00100000:3.0:1790710774.497041:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c80f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b75d7a5-152f-4db9-bf19-5fe279a322e3+12:8111:x1877696158115584:12345-192.168.206.46@tcp:101:mount.lustre.0 00010000:00010000:3.0:1790710774.497062:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790710774.497085:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c51c1645800/0xcbad34b281570dce lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x566877b057000398 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710774.497124:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c51c1645800/0xcbad34b281570dce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000398 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710774.497178:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c51c1645800/0xcbad34b281570dce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000398 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710774.497189:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c1645800, rc 0) 00000100:00100000:3.0:1790710774.497270:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c80f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b75d7a5-152f-4db9-bf19-5fe279a322e3+13:8111:x1877696158115584:12345-192.168.206.46@tcp:101:mount.lustre.0 Request processed in 230us (1036us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710774.497278:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 213 00000100:00100000:1.0:1790710774.499772:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710774.499877:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158115712 00000100:00100000:2.0:1790710774.499889:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158115712 00000100:00100000:2.0:1790710774.499981:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 214 00000100:00100000:2.0:1790710774.499992:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c80f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b75d7a5-152f-4db9-bf19-5fe279a322e3+13:8111:x1877696158115712:12345-192.168.206.46@tcp:501:mount.lustre.0 00000100:00100000:2.0:1790710774.500675:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c80f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b75d7a5-152f-4db9-bf19-5fe279a322e3+13:8111:x1877696158115712:12345-192.168.206.46@tcp:501:mount.lustre.0 Request processed in 680us (912us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710774.500685:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 214 00000100:00100000:0.0:1790710774.502734:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710774.502823:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158115840 00000100:00100000:3.0:1790710774.502833:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158115840 00000100:00100000:3.0:1790710774.502885:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 215 00000100:00100000:3.0:1790710774.502894:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ee788050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b75d7a5-152f-4db9-bf19-5fe279a322e3+13:8111:x1877696158115840:12345-192.168.206.46@tcp:503:mount.lustre.0 00000100:00100000:3.0:1790710774.503340:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ee788050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b75d7a5-152f-4db9-bf19-5fe279a322e3+13:8111:x1877696158115840:12345-192.168.206.46@tcp:503:mount.lustre.0 Request processed in 445us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710774.503349:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 215 00000100:00100000:1.0:1790710774.506836:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710774.506939:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158115968 00000100:00100000:2.0:1790710774.506952:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158115968 00000100:00100000:2.0:1790710774.507033:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 216 00000100:00100000:2.0:1790710774.507044:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ee78b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b75d7a5-152f-4db9-bf19-5fe279a322e3+13:8117:x1877696158115968:12345-192.168.206.46@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790710774.507893:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ee78b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b75d7a5-152f-4db9-bf19-5fe279a322e3+13:8117:x1877696158115968:12345-192.168.206.46@tcp:502:llog_process_th.0 Request processed in 844us (1065us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710774.507904:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 216 00000100:00100000:1.0:1790710774.510356:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710774.510490:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158116096 00000100:00100000:3.0:1790710774.510503:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158116096 00000100:00100000:3.0:1790710774.510568:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 217 00000100:00100000:3.0:1790710774.510579:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ee78ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b75d7a5-152f-4db9-bf19-5fe279a322e3+13:8117:x1877696158116096:12345-192.168.206.46@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790710774.510872:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ee78ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b75d7a5-152f-4db9-bf19-5fe279a322e3+13:8117:x1877696158116096:12345-192.168.206.46@tcp:502:llog_process_th.0 Request processed in 293us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710774.510880:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 217 00000100:00100000:0.0:1790710774.516557:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710774.517062:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158116224 00000100:00100000:3.0:1790710774.517075:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158116224 00000100:00100000:3.0:1790710774.517178:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 10 00000100:00100000:3.0:1790710774.517187:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f978f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2355:x1877696158116224:12345-192.168.206.46@tcp:38:mount.lustre.0 00010000:00080000:3.0:1790710774.517225:0:5847:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 1b59f23d-9a5c-439d-bd4a-453bf2315b97@192.168.206.46@tcp t0 exp 0000000000000000 cur 251 last 0 00000020:00000080:3.0:1790710774.517283:0:5847:0:(genops.c:1384:class_connect()) connect: client 1b59f23d-9a5c-439d-bd4a-453bf2315b97, cookie 0xcbad34b281570dd5 00000004:00100000:3.0:1790710774.517549:0:5847:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1790710774.517892:0:5847:0:(import.c:65:import_set_state_nolock()) ffff9c51f49aa800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790710774.517981:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f978f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1b59f23d-9a5c-439d-bd4a-453bf2315b97+6:2355:x1877696158116224:12345-192.168.206.46@tcp:38:mount.lustre.0 Request processed in 793us (1438us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710774.517990:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 10 00000100:00100000:1.0:1790710774.525799:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710774.525909:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710774.526400:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158116352 00000100:00100000:3.0:1790710774.526413:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158116352 00000100:00100000:3.0:1790710774.526505:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158116480 00000100:00100000:3.0:1790710774.526508:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158116480 00000100:00100000:3.0:1790710774.526550:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 11 00000100:00100000:3.0:1790710774.526560:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9ca1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1b59f23d-9a5c-439d-bd4a-453bf2315b97+7:0:x1877696158116352:12345-192.168.206.46@tcp:41:mount.lustre.0 00000004:00000024:3.0:1790710774.526615:0:5846:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00080000:2.0:1790710774.527783:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790710774.528025:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 12 00000100:00100000:0.0:1790710774.528071:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9ca0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1b59f23d-9a5c-439d-bd4a-453bf2315b97+7:8111:x1877696158116480:12345-192.168.206.46@tcp:41:mount.lustre.0 00000004:00000024:0.0:1790710774.528109:0:8060:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1790710774.530279:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9ca1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1b59f23d-9a5c-439d-bd4a-453bf2315b97+7:0:x1877696158116352:12345-192.168.206.46@tcp:41:mount.lustre.0 Request processed in 3711us (4484us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710774.530294:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 11 00000100:00100000:0.0:1790710774.530335:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9ca0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1b59f23d-9a5c-439d-bd4a-453bf2315b97+6:8111:x1877696158116480:12345-192.168.206.46@tcp:41:mount.lustre.0 Request processed in 2258us (4404us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710774.530348:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 12 00000100:00100000:1.0:1790710774.531777:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710774.532016:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158116608 00000100:00100000:0.0:1790710774.532031:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158116608 00000100:00100000:0.0:1790710774.532122:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 58 00000100:00100000:0.0:1790710774.532177:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9ca3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:2358:x1877696158116608:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:0.0:1790710774.532662:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9ca3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:2358:x1877696158116608:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 487us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710774.532672:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 58 00000100:00100000:3.0:1790710774.536664:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1877696177022592:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790710774.536733:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710774.536974:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177022592 00000100:00100000:0.0:1790710774.536982:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177022592 00000100:00100000:0.0:1790710774.537068:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790710774.537078:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d032d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877696177022592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790710774.537111:0:6700:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790710774.537185:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d032d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877696177022592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710774.537192:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1790710774.537266:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51f4d60e00 x1877696177022592/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790710790 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790710774.537286:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1877696177022592:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790710774.540285:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710774.540444:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158116736 00000100:00100000:3.0:1790710774.540453:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158116736 00000100:00100000:3.0:1790710774.540538:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 13 00000100:00100000:3.0:1790710774.540549:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9ca1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1b59f23d-9a5c-439d-bd4a-453bf2315b97+6:8111:x1877696158116736:12345-192.168.206.46@tcp:40:mount.lustre.0 00000100:00100000:3.0:1790710774.540636:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9ca1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1b59f23d-9a5c-439d-bd4a-453bf2315b97+6:8111:x1877696158116736:12345-192.168.206.46@tcp:40:mount.lustre.0 Request processed in 79us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710774.540643:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 13 00000100:00100000:1.0:1790710774.543371:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710774.543479:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158117120 00000100:00100000:3.0:1790710774.543493:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158117120 00000100:00100000:3.0:1790710774.543576:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 1 00000100:00100000:3.0:1790710774.543586:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9ca1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1b59f23d-9a5c-439d-bd4a-453bf2315b97+6:8111:x1877696158117120:12345-192.168.206.46@tcp:33:mount.lustre.0 00000004:00200000:3.0:1790710774.543663:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1790710774.543777:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9ca1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1b59f23d-9a5c-439d-bd4a-453bf2315b97+6:8111:x1877696158117120:12345-192.168.206.46@tcp:33:mount.lustre.0 Request processed in 192us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710774.543786:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 1 00000100:00100000:1.0:1790710774.547642:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710774.547706:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710774.547800:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158116864 00000100:00100000:0.0:1790710774.547808:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158116864 00000100:00100000:0.0:1790710774.547849:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158116992 00000100:00100000:0.0:1790710774.547852:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158116992 00000100:00100000:0.0:1790710774.547866:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 12 00000100:00100000:0.0:1790710774.547873:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9ca2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2355:x1877696158116864:12345-192.168.206.46@tcp:8:mount.lustre.0 00010000:00080000:0.0:1790710774.547912:0:6697:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 1b59f23d-9a5c-439d-bd4a-453bf2315b97@192.168.206.46@tcp t0 exp 0000000000000000 cur 251 last 0 00000020:00000080:0.0:1790710774.547951:0:6697:0:(genops.c:1384:class_connect()) connect: client 1b59f23d-9a5c-439d-bd4a-453bf2315b97, cookie 0xcbad34b281570ddc 00002000:00100000:0.0:1790710774.547963:0:6697:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 1b59f23d-9a5c-439d-bd4a-453bf2315b97/ffff9c51c722a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790710774.547973:0:6697:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1790710774.548232:0:6697:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1790710774.548681:0:6697:0:(import.c:65:import_set_state_nolock()) ffff9c51c722b800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790710774.548778:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9ca2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1b59f23d-9a5c-439d-bd4a-453bf2315b97+6:2355:x1877696158116864:12345-192.168.206.46@tcp:8:mount.lustre.0 Request processed in 902us (1152us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710774.548786:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 12 00000100:00100000:0.0:1790710774.548806:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 13 00000100:00100000:0.0:1790710774.548811:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4e6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2355:x1877696158116992:12345-192.168.206.46@tcp:8:mount.lustre.0 00010000:00080000:0.0:1790710774.548828:0:6697:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 1b59f23d-9a5c-439d-bd4a-453bf2315b97@192.168.206.46@tcp t0 exp 0000000000000000 cur 251 last 0 00000020:00000080:0.0:1790710774.548845:0:6697:0:(genops.c:1384:class_connect()) connect: client 1b59f23d-9a5c-439d-bd4a-453bf2315b97, cookie 0xcbad34b281570de3 00002000:00100000:0.0:1790710774.548851:0:6697:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 1b59f23d-9a5c-439d-bd4a-453bf2315b97/ffff9c51c722a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790710774.548858:0:6697:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1790710774.548997:0:6697:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1790710774.549012:0:6697:0:(import.c:65:import_set_state_nolock()) ffff9c51c722d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790710774.549035:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4e6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1b59f23d-9a5c-439d-bd4a-453bf2315b97+6:2355:x1877696158116992:12345-192.168.206.46@tcp:8:mount.lustre.0 Request processed in 222us (1329us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710774.549042:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 13 00000001:00100000:1.0:1790710775.125488:0:6720:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1b59f23d-9a5c-439d-bd4a-453bf2315b97 00010000:00010000:2.0:1790710775.303392:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790710776.327793:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790710777.351229:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1790710777.661831:0:5867:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1b59f23d-9a5c-439d-bd4a-453bf2315b97 00000001:00100000:1.0:1790710777.675948:0:7643:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1b59f23d-9a5c-439d-bd4a-453bf2315b97 00010000:00010000:2.0:1790710778.375390:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790710778.631583:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877696177022848:0@lo:400:kworker.0 00000100:00100000:1.0:1790710778.631665:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710778.631742:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1877696177023360:0@lo:400:kworker.0 00000100:00100000:1.0:1790710778.631769:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710778.631798:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1790710778.631805:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d27fc27-b651-404a-bd8c-b798806fb18a:3310:1877696177022720:0@lo:400:kworker.0 00000100:00100000:1.0:1790710778.631832:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710778.631854:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1877696177023232:0@lo:400:kworker.0 00000100:00100000:1.0:1790710778.631875:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710778.631898:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1877696177023104:0@lo:400:kworker.0 00000100:00100000:1.0:1790710778.631935:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710778.631953:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790710778.631958:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1877696177022976:0@lo:400:kworker.0 00000100:00100000:1.0:1790710778.631978:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710778.632005:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177023360 00000100:00100000:1.0:1790710778.632012:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177023360 00000100:00100000:1.0:1790710778.632056:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177023104 00000100:00100000:1.0:1790710778.632059:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177023104 00000100:00100000:1.0:1790710778.632081:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790710778.632088:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4e6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1877696177023360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790710778.632169:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4e6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1877696177023360:12345-0@lo:400:kworker.0 Request processed in 79us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710778.632176:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790710778.632192:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790710778.632198:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4e6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1877696177023104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790710778.632247:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4e6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1877696177023104:12345-0@lo:400:kworker.0 Request processed in 48us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710778.632253:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790710778.632271:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177022720 00000100:00100000:1.0:1790710778.632274:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177022720 00000100:00100000:1.0:1790710778.632295:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1790710778.632302:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ee788c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+19:3310:x1877696177022720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790710778.632332:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ee788c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+19:3310:x1877696177022720:12345-0@lo:400:kworker.0 Request processed in 31us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710778.632339:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00010000:00080000:1.0:1790710778.632379:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51f4d63100 x1877696177023104/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790710794 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790710778.632405:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1877696177023104:0@lo:400:kworker.0 00000100:00100000:1.0:1790710778.632434:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d27fc27-b651-404a-bd8c-b798806fb18a:3310:1877696177022720:0@lo:400:kworker.0 00010000:00080000:1.0:1790710778.632444:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51f4d61880 x1877696177023360/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790710794 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790710778.632451:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1877696177023360:0@lo:400:kworker.0 00000100:00100000:3.0:1790710778.632723:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177022848 00000100:00100000:3.0:1790710778.632728:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177022848 00000100:00100000:3.0:1790710778.632769:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177023232 00000100:00100000:3.0:1790710778.632772:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177023232 00000100:00100000:3.0:1790710778.632783:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177022976 00000100:00100000:3.0:1790710778.632786:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177022976 00000100:00100000:3.0:1790710778.632797:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1790710778.632803:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4e6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1877696177022848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790710778.632848:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4e6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1877696177022848:12345-0@lo:400:kworker.0 Request processed in 45us (1183us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710778.632854:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1790710778.632867:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1790710778.632873:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4e6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1877696177023232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790710778.632901:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4e6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1877696177023232:12345-0@lo:400:kworker.0 Request processed in 28us (1024us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710778.632907:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1790710778.632918:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1790710778.632923:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4e6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1877696177022976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790710778.632958:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4e6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1877696177022976:12345-0@lo:400:kworker.0 Request processed in 34us (979us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710778.632963:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1790710778.632992:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1877696177022976:0@lo:400:kworker.0 00000100:00100000:3.0:1790710778.633014:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1877696177023232:0@lo:400:kworker.0 00000100:00100000:3.0:1790710778.633023:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877696177022848:0@lo:400:kworker.0 00000100:00080000:2.0:1790710778.633190:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790710778.633195:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790710778.633197:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790710779.143662:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790710779.143687:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51d032c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1877696177023488:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790710779.143763:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710779.144013:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177023488 00000100:00100000:3.0:1790710779.144021:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177023488 00000100:00100000:3.0:1790710779.144070:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790710779.144080:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f978fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877696177023488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790710779.144121:0:6699:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790710779.144202:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f978fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877696177023488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710779.144210:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:1.0:1790710779.144339:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51d032c380 x1877696177023488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790710795 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790710779.144356:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51d032c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1877696177023488:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1790710779.399990:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790710779.656023:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1877696177023616:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790710779.656338:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710779.656666:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177023616 00000100:00100000:0.0:1790710779.656677:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177023616 00000100:00100000:0.0:1790710779.656757:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790710779.656769:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4e6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877696177023616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790710779.656817:0:6699:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790710779.656880:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4e6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877696177023616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710779.656887:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1790710779.657104:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51f4d60380 x1877696177023616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790710795 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790710779.657284:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1877696177023616:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790710779.870639:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710779.870679:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710779.870707:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710779.888782:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710779.888828:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710779.888878:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158117376 00000100:00100000:1.0:1790710779.888889:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158117376 00000100:00100000:1.0:1790710779.888961:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158117504 00000100:00100000:1.0:1790710779.888963:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158117504 00000100:00100000:1.0:1790710779.889013:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 62 00000100:00100000:1.0:1790710779.889025:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:2358:x1877696158117376:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:2.0:1790710779.889117:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158117248 00000100:00100000:1.0:1790710779.889121:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:2358:x1877696158117376:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 98us (18492us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710779.889122:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158117248 00000100:00100000:1.0:1790710779.889146:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 62 00000100:00100000:1.0:1790710779.889163:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 63 00000100:00100000:1.0:1790710779.889170:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4e6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1b59f23d-9a5c-439d-bd4a-453bf2315b97+5:2358:x1877696158117504:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:2.0:1790710779.889171:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 219 00000100:00100000:2.0:1790710779.889177:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ee789450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b75d7a5-152f-4db9-bf19-5fe279a322e3+13:2358:x1877696158117248:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:1.0:1790710779.889197:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4e6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1b59f23d-9a5c-439d-bd4a-453bf2315b97+5:2358:x1877696158117504:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 27us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710779.889201:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ee789450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b75d7a5-152f-4db9-bf19-5fe279a322e3+13:2358:x1877696158117248:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 25us (18494us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710779.889203:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 63 00000100:00100000:2.0:1790710779.889208:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 219 00000100:00100000:1.0:1790710779.889220:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158117632 00000100:00100000:1.0:1790710779.889224:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158117632 00000100:00100000:1.0:1790710779.889252:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158117760 00000100:00100000:1.0:1790710779.889255:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158117760 00000100:00100000:1.0:1790710779.889270:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 33 00000100:00100000:1.0:1790710779.889277:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4e6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1b59f23d-9a5c-439d-bd4a-453bf2315b97+5:2358:x1877696158117632:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:1.0:1790710779.889308:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4e6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1b59f23d-9a5c-439d-bd4a-453bf2315b97+5:2358:x1877696158117632:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 32us (18629us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710779.889314:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 33 00000100:00100000:1.0:1790710779.889324:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 34 00000100:00100000:1.0:1790710779.889329:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4e6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1b59f23d-9a5c-439d-bd4a-453bf2315b97+5:2358:x1877696158117760:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:1.0:1790710779.889350:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4e6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1b59f23d-9a5c-439d-bd4a-453bf2315b97+5:2358:x1877696158117760:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 21us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710779.889356:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 34 00000100:00080000:1.0:1790710779.889377:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790710779.889388:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790710779.889391:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1790710780.423414:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790710780.530788:0:10312:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg646-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:2.0:1790710781.448161:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790710782.471302:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790710783.498098:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790710783.752732:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51d032d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1877696177024000:0@lo:400:kworker.0 00000100:00100000:3.0:1790710783.752835:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710783.752965:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790710783.752972:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51d032ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177024128:0@lo:400:kworker.0 00000100:00100000:3.0:1790710783.753005:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710783.753262:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51d032c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d27fc27-b651-404a-bd8c-b798806fb18a:3309:1877696177023744:0@lo:400:kworker.0 00000100:00100000:1.0:1790710783.753327:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710783.753354:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51d032c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1877696177024256:0@lo:400:kworker.0 00000100:00100000:1.0:1790710783.753379:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710783.753402:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1790710783.753408:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51d032ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877696177023872:0@lo:400:kworker.0 00000100:00100000:1.0:1790710783.753442:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710783.753461:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51d032df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1877696177024384:0@lo:400:kworker.0 00000100:00100000:1.0:1790710783.753484:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710783.753520:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177024000 00000100:00100000:1.0:1790710783.753529:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177024000 00000100:00100000:1.0:1790710783.753606:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177024256 00000100:00100000:1.0:1790710783.753610:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177024256 00000100:00100000:1.0:1790710783.753626:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177023872 00000100:00100000:1.0:1790710783.753629:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177023872 00000100:00100000:1.0:1790710783.753644:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1790710783.753654:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d032fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1877696177024000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790710783.753721:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d032fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1877696177024000:12345-0@lo:400:kworker.0 Request processed in 66us (885us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710783.753729:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1790710783.753748:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1790710783.753754:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4e6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1877696177024256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790710783.753785:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4e6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1877696177024256:12345-0@lo:400:kworker.0 Request processed in 31us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710783.753811:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1790710783.753821:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1790710783.753827:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877696177023872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790710783.753855:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877696177023872:12345-0@lo:400:kworker.0 Request processed in 28us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710783.753861:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1790710783.753881:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177024128 00000100:00100000:1.0:1790710783.753884:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177024128 00000100:00100000:3.0:1790710783.755068:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177023744 00000100:00100000:3.0:1790710783.755080:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177023744 00000100:00100000:3.0:1790710783.755148:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1790710783.755157:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ee78bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+19:3309:x1877696177023744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790710783.755251:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ee78bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+19:3309:x1877696177023744:12345-0@lo:400:kworker.0 Request processed in 94us (1922us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710783.755258:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1790710783.758216:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177024384 00000100:00100000:1.0:1790710783.758238:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177024384 00000100:00100000:2.0:1790710783.765418:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1790710783.765463:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d032e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1877696177024128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790710783.765612:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d032e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1877696177024128:12345-0@lo:400:kworker.0 Request processed in 167us (12605us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710783.765622:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1790710783.765650:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790710783.765659:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4e6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1877696177024384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790710783.765710:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4e6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1877696177024384:12345-0@lo:400:kworker.0 Request processed in 52us (12224us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710783.765717:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1790710783.773364:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790710783.773379:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790710783.773383:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790710783.773554:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51d032ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877696177023872:0@lo:400:kworker.0 00010000:00080000:1.0:1790710783.773593:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51d032df80 x1877696177024384/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790710799 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790710783.773605:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51d032df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1877696177024384:0@lo:400:kworker.0 00000100:00100000:1.0:1790710783.773619:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51d032c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d27fc27-b651-404a-bd8c-b798806fb18a:3309:1877696177023744:0@lo:400:kworker.0 00000100:00100000:1.0:1790710783.773634:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51d032c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1877696177024256:0@lo:400:kworker.0 00010000:00080000:1.0:1790710783.773697:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51d032ce00 x1877696177024128/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790710799 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790710783.773709:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51d032ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177024128:0@lo:400:kworker.0 00000100:00100000:1.0:1790710783.773724:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51d032d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1877696177024000:0@lo:400:kworker.0 00000100:00100000:2.0:1790710784.263798:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51d032ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177024512:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790710784.263886:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710784.264033:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177024512 00000100:00100000:3.0:1790710784.264044:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177024512 00000100:00100000:3.0:1790710784.264108:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790710784.264120:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877696177024512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790710784.264189:0:6699:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790710784.264248:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877696177024512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 131us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710784.264256:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:3.0:1790710784.264304:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51d032ea00 x1877696177024512/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790710800 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790710784.264347:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51d032ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177024512:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1790710784.519920:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790710784.775475:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4e6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1877696177024640:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790710784.776400:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710784.779242:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177024640 00000100:00100000:3.0:1790710784.779264:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177024640 00000100:00100000:3.0:1790710784.779341:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790710784.779353:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f978d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877696177024640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790710784.779403:0:6699:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790710784.779513:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f978d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877696177024640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 162us (3116us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710784.779521:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1790710784.784900:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51f4e6dc00 x1877696177024640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790710800 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790710784.784936:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4e6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1877696177024640:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790710784.989198:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710784.989226:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710784.989251:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710784.989272:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710784.989294:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710784.989318:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158118272 00000100:00100000:0.0:1790710784.989327:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158118272 00000100:00100000:0.0:1790710784.989376:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158118400 00000100:00100000:0.0:1790710784.989379:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158118400 00000100:00100000:0.0:1790710784.989396:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 37 00000100:00100000:0.0:1790710784.989407:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f978f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1b59f23d-9a5c-439d-bd4a-453bf2315b97+5:2357:x1877696158118272:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:0.0:1790710784.989471:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f978f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1b59f23d-9a5c-439d-bd4a-453bf2315b97+5:2357:x1877696158118272:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 67us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710784.989478:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 37 00000100:00100000:0.0:1790710784.989494:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 38 00000100:00100000:0.0:1790710784.989501:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f978df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1b59f23d-9a5c-439d-bd4a-453bf2315b97+5:2357:x1877696158118400:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:0.0:1790710784.989525:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f978df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1b59f23d-9a5c-439d-bd4a-453bf2315b97+5:2357:x1877696158118400:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 25us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710784.989546:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 38 00000100:00100000:0.0:1790710784.989565:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158117888 00000100:00100000:0.0:1790710784.989569:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158117888 00000100:00100000:0.0:1790710784.989604:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 221 00000100:00100000:0.0:1790710784.989610:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ee78a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b75d7a5-152f-4db9-bf19-5fe279a322e3+13:2357:x1877696158117888:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:0.0:1790710784.989635:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ee78a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b75d7a5-152f-4db9-bf19-5fe279a322e3+13:2357:x1877696158117888:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 25us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710784.989641:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 221 00000100:00100000:0.0:1790710784.989665:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158118016 00000100:00100000:0.0:1790710784.989668:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158118016 00000100:00100000:0.0:1790710784.989692:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158118144 00000100:00100000:0.0:1790710784.989694:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158118144 00000100:00100000:0.0:1790710784.989711:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 67 00000100:00100000:0.0:1790710784.989717:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f978ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:2357:x1877696158118016:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:0.0:1790710784.989742:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f978ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:2357:x1877696158118016:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 25us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710784.989748:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 67 00000100:00100000:0.0:1790710784.989758:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 68 00000100:00100000:0.0:1790710784.989781:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f978d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1b59f23d-9a5c-439d-bd4a-453bf2315b97+5:2357:x1877696158118144:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:0.0:1790710784.989801:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f978d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1b59f23d-9a5c-439d-bd4a-453bf2315b97+5:2357:x1877696158118144:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 23us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710784.989816:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 68 00000100:00080000:0.0:1790710784.989835:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790710784.989840:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790710784.989842:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1790710785.548152:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790710786.568362:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710787.592290:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790710788.616361:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790710788.872280:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51d032c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877696177024896:0@lo:400:kworker.0 00000100:00100000:3.0:1790710788.872388:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710788.872471:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51d032dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1877696177025024:0@lo:400:kworker.0 00000100:00100000:1.0:1790710788.873584:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51d032ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d27fc27-b651-404a-bd8c-b798806fb18a:3309:1877696177024768:0@lo:400:kworker.0 00000100:00100000:2.0:1790710788.886481:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710788.886596:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790710788.886613:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51d032f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177025152:0@lo:400:kworker.0 00000100:00100000:2.0:1790710788.886673:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710788.887098:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177024896 00000100:00100000:0.0:1790710788.887109:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177024896 00000100:00100000:0.0:1790710788.887192:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177025024 00000100:00100000:0.0:1790710788.887195:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177025024 00000100:00100000:0.0:1790710788.887230:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1790710788.887241:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d032c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1877696177024896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790710788.887310:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d032c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1877696177024896:12345-0@lo:400:kworker.0 Request processed in 71us (14923us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710788.887318:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1790710788.887333:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1790710788.887339:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1877696177025024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790710788.887366:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1877696177025024:12345-0@lo:400:kworker.0 Request processed in 28us (896us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710788.887372:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1790710788.887400:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177025152 00000100:00100000:0.0:1790710788.887403:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177025152 00000100:00100000:0.0:1790710788.887429:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1790710788.887435:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1877696177025152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790710788.887474:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1877696177025152:12345-0@lo:400:kworker.0 Request processed in 39us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710788.887481:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:0.0:1790710788.887496:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790710788.887501:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1790710788.887535:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51d032f800 x1877696177025152/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790710804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790710788.887559:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51d032f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177025152:0@lo:400:kworker.0 00000100:00100000:0.0:1790710788.887574:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51d032dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1877696177025024:0@lo:400:kworker.0 00000100:00100000:3.0:1790710788.899886:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51d032c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877696177024896:0@lo:400:kworker.0 00000100:00100000:3.0:1790710788.899907:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51d032ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1877696177025408:0@lo:400:kworker.0 00000100:00100000:3.0:1790710788.899988:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710788.900118:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710788.908448:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177025408 00000100:00100000:2.0:1790710788.908468:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177025408 00000100:00080000:0.0:1790710788.911078:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790710788.912046:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790710788.912065:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d032c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1877696177025408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790710788.912475:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d032c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1877696177025408:12345-0@lo:400:kworker.0 Request processed in 419us (12487us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710788.912484:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:3.0:1790710788.921833:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51d032ce00 x1877696177025408/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790710804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790710788.921857:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51d032ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1877696177025408:0@lo:400:kworker.0 00000100:00100000:3.0:1790710788.921941:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51d032d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1877696177025280:0@lo:400:kworker.0 00000100:00100000:3.0:1790710788.923500:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710788.925221:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177025280 00000100:00100000:3.0:1790710788.925240:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177025280 00000100:00100000:3.0:1790710788.925343:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1790710788.925355:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d032ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1877696177025280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790710788.925474:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d032ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1877696177025280:12345-0@lo:400:kworker.0 Request processed in 121us (1978us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710788.925482:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1790710788.925632:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51d032d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1877696177025280:0@lo:400:kworker.0 00000100:00080000:2.0:1790710788.927314:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790710788.934918:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177024768 00000100:00100000:1.0:1790710788.934937:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177024768 00000100:00100000:1.0:1790710788.935022:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1790710788.935035:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ee78b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+19:3309:x1877696177024768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790710788.935175:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ee78b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+19:3309:x1877696177024768:12345-0@lo:400:kworker.0 Request processed in 142us (35056us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710788.935184:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1790710788.935255:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51d032ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d27fc27-b651-404a-bd8c-b798806fb18a:3309:1877696177024768:0@lo:400:kworker.0 00000100:00100000:1.0:1790710789.385192:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790710789.385223:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f978c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1877696177025536:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790710789.385289:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710789.385896:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177025536 00000100:00100000:3.0:1790710789.385906:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177025536 00000100:00100000:3.0:1790710789.386034:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790710789.386045:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4e6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877696177025536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790710789.386080:0:6699:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790710789.386166:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4e6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877696177025536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710789.386173:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:1.0:1790710789.387650:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51f978c000 x1877696177025536/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790710805 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790710789.387675:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f978c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1877696177025536:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1790710789.639247:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790710789.900869:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1877696177025664:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790710789.900934:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710789.901803:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177025664 00000100:00100000:3.0:1790710789.901811:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177025664 00000100:00100000:3.0:1790710789.901860:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1790710789.901870:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877696177025664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790710789.901902:0:6699:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790710789.902067:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877696177025664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 198us (1131us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710789.902074:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1790710789.903954:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51f4d63800 x1877696177025664/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790710805 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790710789.903979:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1877696177025664:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790710790.110796:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710790.110833:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710790.110863:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710790.110886:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710790.110928:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710790.110954:0:6696:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158118912 00000100:00100000:0.0:1790710790.110962:0:6696:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158118912 00000100:00100000:0.0:1790710790.111013:0:6696:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158119040 00000100:00100000:0.0:1790710790.111017:0:6696:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158119040 00000100:00100000:0.0:1790710790.111036:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 41 00000100:00100000:0.0:1790710790.111045:0:6696:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f978e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1b59f23d-9a5c-439d-bd4a-453bf2315b97+5:2356:x1877696158118912:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:0.0:1790710790.111110:0:6696:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f978e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1b59f23d-9a5c-439d-bd4a-453bf2315b97+5:2356:x1877696158118912:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 66us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710790.111118:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 41 00000100:00100000:0.0:1790710790.111153:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 42 00000100:00100000:0.0:1790710790.111161:0:6696:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9a53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1b59f23d-9a5c-439d-bd4a-453bf2315b97+5:2356:x1877696158119040:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:0.0:1790710790.111186:0:6696:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9a53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1b59f23d-9a5c-439d-bd4a-453bf2315b97+5:2356:x1877696158119040:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 26us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710790.111192:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 42 00000100:00100000:0.0:1790710790.111336:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158118528 00000100:00100000:0.0:1790710790.111341:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158118528 00000100:00100000:0.0:1790710790.111373:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 223 00000100:00100000:0.0:1790710790.111380:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ee78a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b75d7a5-152f-4db9-bf19-5fe279a322e3+13:2356:x1877696158118528:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:0.0:1790710790.111421:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ee78a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b75d7a5-152f-4db9-bf19-5fe279a322e3+13:2356:x1877696158118528:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 41us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710790.111438:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 223 00000100:00100000:0.0:1790710790.111464:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158118656 00000100:00100000:0.0:1790710790.111467:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158118656 00000100:00100000:0.0:1790710790.111491:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158118784 00000100:00100000:0.0:1790710790.111494:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158118784 00000100:00100000:0.0:1790710790.111515:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 72 00000100:00100000:0.0:1790710790.111523:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f978e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:2356:x1877696158118656:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:0.0:1790710790.111568:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f978e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:2356:x1877696158118656:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 46us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710790.111574:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 72 00000100:00100000:0.0:1790710790.111586:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 73 00000100:00100000:0.0:1790710790.111592:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f978c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1b59f23d-9a5c-439d-bd4a-453bf2315b97+5:2356:x1877696158118784:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:0.0:1790710790.111613:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f978c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1b59f23d-9a5c-439d-bd4a-453bf2315b97+5:2356:x1877696158118784:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 22us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710790.111618:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 73 00000100:00080000:2.0:1790710790.115770:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790710790.115780:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790710790.115783:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1790710790.666827:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790710791.692082:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790710792.712681:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710793.735789:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790710793.993178:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1877696177026176:0@lo:400:kworker.0 00000100:00100000:2.0:1790710793.993241:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710793.993300:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790710793.993307:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1877696177026048:0@lo:400:kworker.0 00000100:00100000:2.0:1790710793.993332:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710793.993432:0:6696:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177026176 00000100:00100000:0.0:1790710793.993440:0:6696:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177026176 00000100:00100000:0.0:1790710793.993501:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1790710793.993625:0:6696:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1877696177026176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790710793.993685:0:6696:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1877696177026176:12345-0@lo:400:kworker.0 Request processed in 65us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710793.993693:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1790710793.993714:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177026048 00000100:00100000:0.0:1790710793.993718:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177026048 00000100:00100000:0.0:1790710793.993743:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1790710793.993762:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1877696177026048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790710793.993799:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1877696177026048:12345-0@lo:400:kworker.0 Request processed in 33us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710793.993805:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1790710793.993844:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1877696177026048:0@lo:400:kworker.0 00010000:00080000:0.0:1790710793.993855:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51f4d60380 x1877696177026176/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790710809 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790710793.993880:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1877696177026176:0@lo:400:kworker.0 00000100:00100000:1.0:1790710793.994008:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d27fc27-b651-404a-bd8c-b798806fb18a:3309:1877696177025792:0@lo:400:kworker.0 00000100:00100000:1.0:1790710793.994043:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710793.994074:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1877696177026304:0@lo:400:kworker.0 00000100:00100000:1.0:1790710793.994093:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710793.994112:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1790710793.994118:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877696177025920:0@lo:400:kworker.0 00000100:00100000:1.0:1790710793.994165:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710793.994181:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1877696177026432:0@lo:400:kworker.0 00000100:00100000:1.0:1790710793.994198:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710793.994220:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177026304 00000100:00100000:1.0:1790710793.994224:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177026304 00000100:00100000:1.0:1790710793.994248:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177025920 00000100:00100000:1.0:1790710793.994251:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177025920 00000100:00100000:1.0:1790710793.994265:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1790710793.994270:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4e6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1877696177026304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790710793.994304:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4e6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1877696177026304:12345-0@lo:400:kworker.0 Request processed in 33us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710793.994310:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1790710793.994322:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1790710793.994328:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4e6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877696177025920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790710793.994353:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4e6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877696177025920:12345-0@lo:400:kworker.0 Request processed in 26us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710793.994359:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1790710793.994376:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177026432 00000100:00100000:1.0:1790710793.994380:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177026432 00000100:00100000:1.0:1790710793.994403:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1790710793.994409:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4e6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1877696177026432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790710793.994445:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4e6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1877696177026432:12345-0@lo:400:kworker.0 Request processed in 37us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710793.994451:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1790710793.994482:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877696177025920:0@lo:400:kworker.0 00010000:00080000:1.0:1790710793.994491:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51f4d61180 x1877696177026432/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790710809 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790710793.994499:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1877696177026432:0@lo:400:kworker.0 00000100:00100000:1.0:1790710793.994506:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1877696177026304:0@lo:400:kworker.0 00000100:00080000:2.0:1790710793.994581:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790710793.994585:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790710793.994587:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790710793.994674:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177025792 00000100:00100000:0.0:1790710793.994678:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177025792 00000100:00100000:0.0:1790710793.994712:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1790710793.994719:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ee788450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+19:3309:x1877696177025792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790710793.994762:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ee788450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+19:3309:x1877696177025792:12345-0@lo:400:kworker.0 Request processed in 44us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710793.994768:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1790710793.994878:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d27fc27-b651-404a-bd8c-b798806fb18a:3309:1877696177025792:0@lo:400:kworker.0 00000100:00100000:0.0:1790710794.506571:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f978f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177026560:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790710794.506641:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710794.506720:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177026560 00000100:00100000:0.0:1790710794.506728:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177026560 00000100:00100000:0.0:1790710794.506773:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1790710794.506782:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f978dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877696177026560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790710794.506816:0:6699:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790710794.506858:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f978dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877696177026560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710794.506864:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:0.0:1790710794.506917:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51f978f480 x1877696177026560/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790710810 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790710794.506934:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f978f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177026560:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1790710794.786040:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790710795.017566:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790710795.017586:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4e6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177026688:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790710795.017644:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710795.018592:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177026688 00000100:00100000:0.0:1790710795.018603:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177026688 00000100:00100000:0.0:1790710795.018676:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790710795.018687:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d032d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877696177026688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790710795.018725:0:6699:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790710795.018789:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d032d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877696177026688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (1142us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710795.018798:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1790710795.018852:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51f4e6fb80 x1877696177026688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790710811 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790710795.018876:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4e6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177026688:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1790710795.018927:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790710795.230095:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710795.230175:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710795.230210:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710795.230240:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710795.230265:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710795.230291:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158119552 00000100:00100000:0.0:1790710795.230299:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158119552 00000100:00100000:2.0:1790710795.230329:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158119424 00000100:00100000:2.0:1790710795.230335:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158119424 00000100:00100000:0.0:1790710795.230356:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158119680 00000100:00100000:0.0:1790710795.230362:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158119680 00000100:00100000:2.0:1790710795.230369:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158119296 00000100:00100000:2.0:1790710795.230374:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158119296 00000100:00100000:2.0:1790710795.230394:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 77 00000100:00100000:2.0:1790710795.230403:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f978f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1b59f23d-9a5c-439d-bd4a-453bf2315b97+5:2356:x1877696158119424:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:2.0:1790710795.230596:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f978f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1b59f23d-9a5c-439d-bd4a-453bf2315b97+5:2356:x1877696158119424:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 191us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710795.230604:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 77 00000100:00100000:2.0:1790710795.230622:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 78 00000100:00100000:2.0:1790710795.230628:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f978f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:2356:x1877696158119296:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:2.0:1790710795.230655:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f978f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:2356:x1877696158119296:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 28us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710795.230662:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 78 00000100:00100000:1.0:1790710795.230700:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158119168 00000100:00100000:1.0:1790710795.230705:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158119168 00000100:00100000:1.0:1790710795.230741:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 225 00000100:00100000:2.0:1790710795.230745:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 14 00000100:00100000:1.0:1790710795.230753:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ee788850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b75d7a5-152f-4db9-bf19-5fe279a322e3+13:2356:x1877696158119168:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:2.0:1790710795.230759:0:6696:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f978df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1b59f23d-9a5c-439d-bd4a-453bf2315b97+5:2355:x1877696158119552:12345-192.168.206.46@tcp:9:kworker.0 00000020:00000080:2.0:1790710795.230781:0:6696:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcbad34b281570ddc 00000100:00100000:1.0:1790710795.230788:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ee788850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b75d7a5-152f-4db9-bf19-5fe279a322e3+13:2356:x1877696158119168:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 37us (699us total) trans 0 rc 0/0 00000100:00080000:2.0:1790710795.230791:0:6696:0:(import.c:65:import_set_state_nolock()) ffff9c51c722b800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1790710795.230797:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 225 00010000:00010000:1.0:1790710795.230826:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1790710795.230832:0:6696:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00080000:1.0:1790710795.230841:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790710795.230846:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790710795.231213:0:6696:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f978df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1b59f23d-9a5c-439d-bd4a-453bf2315b97+2:2355:x1877696158119552:12345-192.168.206.46@tcp:9:kworker.0 Request processed in 458us (971us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710795.231221:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 14 00000100:00100000:0.0:1790710795.231322:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 15 00000100:00100000:0.0:1790710795.231330:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f978e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1b59f23d-9a5c-439d-bd4a-453bf2315b97+5:2355:x1877696158119680:12345-192.168.206.46@tcp:9:kworker.0 00000020:00000080:0.0:1790710795.231355:0:6697:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcbad34b281570de3 00000100:00080000:0.0:1790710795.231361:0:6697:0:(import.c:65:import_set_state_nolock()) ffff9c51c722d000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790710795.231400:0:6697:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1790710795.231807:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f978e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1b59f23d-9a5c-439d-bd4a-453bf2315b97+2:2355:x1877696158119680:12345-192.168.206.46@tcp:9:kworker.0 Request processed in 477us (1539us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710795.231814:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 15 00010000:00010000:0.0:1790710795.231830:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790710795.233553:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:2.0:1790710795.615506:0:6720:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1b59f23d-9a5c-439d-bd4a-453bf2315b97 00000020:00000080:2.0:1790710795.615528:0:6720:0:(genops.c:885:class_export_put()) final put ffff9c51c722a800/1b59f23d-9a5c-439d-bd4a-453bf2315b97 00000020:00000080:3.0:1790710795.615829:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c51c722a800/1b59f23d-9a5c-439d-bd4a-453bf2315b97 for lustre-OST0000 00000020:00000080:3.0:1790710795.615878:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c51c722b800 for lustre-OST0000 00010000:00010000:0.0:1790710795.783321:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790710796.807314:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790710797.835171:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1790710798.177331:0:7643:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1b59f23d-9a5c-439d-bd4a-453bf2315b97 00000020:00000080:3.0:1790710798.177340:0:7643:0:(genops.c:885:class_export_put()) final put ffff9c51c722a000/1b59f23d-9a5c-439d-bd4a-453bf2315b97 00000020:00000080:0.0:1790710798.177595:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9c51c722a000/1b59f23d-9a5c-439d-bd4a-453bf2315b97 for lustre-OST0001 00000020:00000080:0.0:1790710798.177643:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c51c722d000 for lustre-OST0001 00010000:00010000:0.0:1790710798.856279:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790710799.111658:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51d032ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1877696177027072:0@lo:400:kworker.0 00000100:00100000:0.0:1790710799.111730:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710799.111825:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790710799.111832:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51d032ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177027200:0@lo:400:kworker.0 00000100:00100000:0.0:1790710799.111860:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710799.112086:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177027072 00000100:00100000:3.0:1790710799.112093:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177027072 00000100:00100000:3.0:1790710799.112173:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1790710799.112183:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8e8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1877696177027072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790710799.112250:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8e8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1877696177027072:12345-0@lo:400:kworker.0 Request processed in 68us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710799.112257:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:0.0:1790710799.112330:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790710799.112362:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51d032ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1877696177027072:0@lo:400:kworker.0 00000100:00100000:2.0:1790710799.112956:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51d032df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877696177026944:0@lo:400:kworker.0 00000100:00100000:2.0:1790710799.112990:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710799.113023:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51d032c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1877696177027456:0@lo:400:kworker.0 00000100:00100000:2.0:1790710799.113044:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710799.113120:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1790710799.113148:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51d032c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d27fc27-b651-404a-bd8c-b798806fb18a:3310:1877696177026816:0@lo:400:kworker.0 00000100:00100000:2.0:1790710799.113177:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710799.113200:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51d032e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1877696177027328:0@lo:400:kworker.0 00000100:00100000:2.0:1790710799.113222:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710799.113288:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177026944 00000100:00100000:3.0:1790710799.113293:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177026944 00000100:00100000:3.0:1790710799.113321:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177027328 00000100:00100000:3.0:1790710799.113325:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177027328 00000100:00100000:3.0:1790710799.113351:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1790710799.113357:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1877696177026944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790710799.113401:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1877696177026944:12345-0@lo:400:kworker.0 Request processed in 44us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710799.113407:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1790710799.113424:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1790710799.113431:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1877696177027328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790710799.113459:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1877696177027328:12345-0@lo:400:kworker.0 Request processed in 29us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710799.113465:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1790710799.113513:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177026816 00000100:00100000:3.0:1790710799.113517:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177026816 00000100:00100000:3.0:1790710799.113540:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1790710799.113546:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ee78a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+19:3310:x1877696177026816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790710799.113604:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ee78a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+19:3310:x1877696177026816:12345-0@lo:400:kworker.0 Request processed in 58us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710799.113610:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1790710799.113663:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51d032c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d27fc27-b651-404a-bd8c-b798806fb18a:3310:1877696177026816:0@lo:400:kworker.0 00000100:00100000:3.0:1790710799.113674:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51d032e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1877696177027328:0@lo:400:kworker.0 00000100:00100000:3.0:1790710799.113682:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51d032df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877696177026944:0@lo:400:kworker.0 00000100:00080000:1.0:1790710799.113972:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790710799.114534:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177027200 00000100:00100000:0.0:1790710799.114541:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177027200 00000100:00100000:0.0:1790710799.114591:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177027456 00000100:00100000:0.0:1790710799.114595:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177027456 00000100:00100000:0.0:1790710799.114612:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1790710799.114619:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8e8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1877696177027200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790710799.114671:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8e8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1877696177027200:12345-0@lo:400:kworker.0 Request processed in 53us (2810us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710799.114678:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1790710799.114700:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1790710799.114706:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1877696177027456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790710799.114743:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1877696177027456:12345-0@lo:400:kworker.0 Request processed in 37us (1697us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710799.114749:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:0.0:1790710799.114780:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51d032ed80 x1877696177027200/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790710815 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790710799.114792:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51d032ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177027200:0@lo:400:kworker.0 00010000:00080000:0.0:1790710799.114817:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51d032c380 x1877696177027456/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790710815 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790710799.114825:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51d032c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1877696177027456:0@lo:400:kworker.0 00000100:00080000:1.0:1790710799.114964:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790710799.114968:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790710799.625904:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51d032df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177027584:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790710799.625971:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710799.626039:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177027584 00000100:00100000:0.0:1790710799.626046:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177027584 00000100:00100000:0.0:1790710799.626095:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1790710799.626104:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8e8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877696177027584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790710799.626153:0:6699:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790710799.626194:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8e8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877696177027584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710799.626202:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:0.0:1790710799.626268:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51d032df80 x1877696177027584/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790710815 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790710799.626286:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51d032df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177027584:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1790710799.879348:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790710800.138408:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4e6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1877696177027712:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790710800.138475:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710800.138535:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177027712 00000100:00100000:1.0:1790710800.138549:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177027712 00000100:00100000:1.0:1790710800.138612:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1790710800.138622:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8e8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877696177027712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790710800.138660:0:6699:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790710800.138718:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8e8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877696177027712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710800.138726:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1790710800.138978:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51f4e6ca80 x1877696177027712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790710816 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790710800.138998:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4e6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1877696177027712:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790710800.349210:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710800.349247:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710800.349281:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710800.349306:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158119808 00000100:00100000:1.0:1790710800.349315:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158119808 00000100:00100000:2.0:1790710800.349440:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158119936 00000100:00100000:2.0:1790710800.349446:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158119936 00000100:00100000:2.0:1790710800.349487:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158120064 00000100:00100000:2.0:1790710800.349491:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158120064 00000100:00100000:2.0:1790710800.349922:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 82 00000100:00100000:1.0:1790710800.349928:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 227 00000100:00100000:2.0:1790710800.349936:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9576d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:2356:x1877696158119936:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:1.0:1790710800.349942:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ee789850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b75d7a5-152f-4db9-bf19-5fe279a322e3+13:2356:x1877696158119808:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:1.0:1790710800.350011:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ee789850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b75d7a5-152f-4db9-bf19-5fe279a322e3+13:2356:x1877696158119808:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 74us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710800.350018:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 227 00000100:00100000:3.0:1790710800.350248:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 83 00000100:00100000:2.0:1790710800.350397:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9576d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:2356:x1877696158119936:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 465us (1194us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710800.350404:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 82 00000100:00080000:2.0:1790710800.350425:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790710800.357046:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9577800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1b59f23d-9a5c-439d-bd4a-453bf2315b97+5:2356:x1877696158120064:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:3.0:1790710800.357647:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9577800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1b59f23d-9a5c-439d-bd4a-453bf2315b97+5:2356:x1877696158120064:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 7385us (8359us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710800.357657:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 83 00010000:00010000:3.0:1790710800.907867:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790710801.784468:0:11013:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1790710801.933641:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790710802.952286:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790710803.976725:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790710804.231920:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4e6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1877696177028096:0@lo:400:kworker.0 00000100:00100000:1.0:1790710804.232006:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710804.232059:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790710804.232066:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4e6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177028224:0@lo:400:kworker.0 00000100:00100000:1.0:1790710804.232093:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710804.232166:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177028224 00000100:00100000:1.0:1790710804.232173:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177028224 00000100:00100000:1.0:1790710804.232223:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1790710804.232231:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9b04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1877696177028224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790710804.232279:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9b04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1877696177028224:12345-0@lo:400:kworker.0 Request processed in 48us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710804.232294:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:1.0:1790710804.232333:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51f4e6c000 x1877696177028224/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790710820 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790710804.232347:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4e6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177028224:0@lo:400:kworker.0 00000100:00100000:3.0:1790710804.232542:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4e6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877696177027968:0@lo:400:kworker.0 00000100:00100000:3.0:1790710804.232573:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710804.232601:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4e6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1877696177028480:0@lo:400:kworker.0 00000100:00100000:3.0:1790710804.232623:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710804.232646:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1790710804.232651:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4e6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d27fc27-b651-404a-bd8c-b798806fb18a:3310:1877696177027840:0@lo:400:kworker.0 00000100:00100000:3.0:1790710804.232675:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710804.232691:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4e6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1877696177028352:0@lo:400:kworker.0 00000100:00100000:3.0:1790710804.232710:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710804.232732:0:6696:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177028480 00000100:00100000:3.0:1790710804.232743:0:6696:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177028480 00000100:00100000:3.0:1790710804.232769:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1790710804.232776:0:6696:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d032c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1877696177028480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790710804.232812:0:6696:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d032c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1877696177028480:12345-0@lo:400:kworker.0 Request processed in 35us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710804.232819:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:3.0:1790710804.232846:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51f4e6fb80 x1877696177028480/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790710820 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790710804.232854:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4e6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1877696177028480:0@lo:400:kworker.0 00000100:00100000:2.0:1790710804.233045:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177028096 00000100:00100000:2.0:1790710804.233050:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177028096 00000100:00100000:2.0:1790710804.233083:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177027968 00000100:00100000:2.0:1790710804.233086:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177027968 00000100:00100000:2.0:1790710804.233099:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177028352 00000100:00100000:2.0:1790710804.233102:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177028352 00000100:00100000:2.0:1790710804.233115:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1790710804.233121:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9b05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1877696177028096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790710804.233185:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9b05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1877696177028096:12345-0@lo:400:kworker.0 Request processed in 63us (1179us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710804.233191:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1790710804.233206:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1790710804.233213:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d032e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1877696177027968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790710804.233246:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d032e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1877696177027968:12345-0@lo:400:kworker.0 Request processed in 34us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710804.233252:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1790710804.233264:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1790710804.233270:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d032ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1877696177028352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790710804.233297:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d032ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1877696177028352:12345-0@lo:400:kworker.0 Request processed in 27us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710804.233301:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:2.0:1790710804.233318:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790710804.233328:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790710804.233331:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790710804.233358:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4e6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1877696177028352:0@lo:400:kworker.0 00000100:00100000:2.0:1790710804.233367:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4e6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877696177027968:0@lo:400:kworker.0 00000100:00100000:2.0:1790710804.233413:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4e6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1877696177028096:0@lo:400:kworker.0 00000100:00100000:1.0:1790710804.234163:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177027840 00000100:00100000:1.0:1790710804.234169:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177027840 00000100:00100000:1.0:1790710804.234212:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1790710804.234221:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ee789050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+19:3310:x1877696177027840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790710804.234549:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ee789050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+19:3310:x1877696177027840:12345-0@lo:400:kworker.0 Request processed in 329us (1872us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710804.234557:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1790710804.241434:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4e6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d27fc27-b651-404a-bd8c-b798806fb18a:3310:1877696177027840:0@lo:400:kworker.0 00000100:00100000:2.0:1790710804.743689:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9575500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177028608:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790710804.743756:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710804.744098:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177028608 00000100:00100000:1.0:1790710804.744107:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177028608 00000100:00100000:1.0:1790710804.744172:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790710804.744181:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877696177028608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790710804.744215:0:6699:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790710804.744274:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877696177028608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710804.744282:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:2.0:1790710804.744452:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51f9575500 x1877696177028608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790710820 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790710804.744480:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9575500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177028608:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1790710805.001301:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790710805.255397:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790710805.255421:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9b05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177028736:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790710805.255503:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710805.255724:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177028736 00000100:00100000:1.0:1790710805.255732:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177028736 00000100:00100000:1.0:1790710805.255781:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1790710805.255790:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877696177028736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790710805.255823:0:6699:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790710805.255875:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877696177028736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710805.255894:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1790710805.256674:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51f9b05f80 x1877696177028736/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790710821 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790710805.256692:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9b05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177028736:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790710805.471751:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710805.471788:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710805.471826:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710805.471854:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158120192 00000100:00100000:3.0:1790710805.471862:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158120192 00000100:00100000:3.0:1790710805.471905:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 229 00000100:00100000:3.0:1790710805.471914:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ee78b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b75d7a5-152f-4db9-bf19-5fe279a322e3+13:2358:x1877696158120192:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:3.0:1790710805.471975:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ee78b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b75d7a5-152f-4db9-bf19-5fe279a322e3+13:2358:x1877696158120192:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 63us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710805.471983:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 229 00000100:00100000:3.0:1790710805.472013:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158120320 00000100:00100000:3.0:1790710805.472016:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158120320 00000100:00100000:3.0:1790710805.472048:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158120448 00000100:00100000:3.0:1790710805.472055:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158120448 00000100:00100000:3.0:1790710805.472090:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 87 00000100:00100000:3.0:1790710805.472097:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d032dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:2358:x1877696158120320:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:3.0:1790710805.472146:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d032dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:2358:x1877696158120320:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 50us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710805.472152:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 87 00000100:00100000:3.0:1790710805.472165:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 88 00000100:00100000:3.0:1790710805.472171:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d032f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1b59f23d-9a5c-439d-bd4a-453bf2315b97+5:2359:x1877696158120448:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:3.0:1790710805.472196:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d032f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1b59f23d-9a5c-439d-bd4a-453bf2315b97+5:2359:x1877696158120448:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 26us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710805.472203:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 88 00000100:00080000:3.0:1790710805.472327:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:1.0:1790710805.979915:0:11161:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe2a437510 20000000:00000080:1.0:1790710805.979931:0:11161:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c51c6498400 uarg=0000000000000000 20000000:01000000:1.0:1790710805.979966:0:11161:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1790710805.979972:0:11161:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1790710805.979977:0:11161:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1790710805.984530:0:11162:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1790710805.984944:0:11161:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1790710805.993301:0:11161:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1790710805.993496:0:11161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c51c1645e00/0xcbad34b281570dea lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710805.993517:0:11161:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c51c0030c00/0xcbad34b281570d8f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000360 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710805.993527:0:11161:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c51c6481200/0xcbad34b281570d9d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281570d96 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710805.993534:0:11161:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c51c0030800/0xcbad34b281570dab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281570da4 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710805.993541:0:11161:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c51c0030000/0xcbad34b281570db9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281570db2 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710805.993548:0:11161:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c51c1645800/0xcbad34b281570dce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000398 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710805.993571:0:11161:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c51c1645e00/0xcbad34b281570dea lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710805.993611:0:11161:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c51c1645800/0xcbad34b281570dce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.46@tcp remote: 0x566877b057000398 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710805.993623:0:11161:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c51c1645800/0xcbad34b281570dce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000398 expref: 12 pid: 5837 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710805.993634:0:11161:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51d032df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11161:1877696177028864:192.168.206.46@tcp:104: 00010000:00010000:3.0:1790710805.993734:0:11161:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c51c0030000/0xcbad34b281570db9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbad34b281570db2 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710805.993744:0:11161:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c51c0030000/0xcbad34b281570db9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbad34b281570db2 expref: 18 pid: 5838 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710805.993753:0:11161:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51d032c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11161:1877696177028992:0@lo:104: 00000100:00100000:3.0:1790710805.993796:0:11161:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790710805.993900:0:11161:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c51c0030800/0xcbad34b281570dab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbad34b281570da4 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710805.993908:0:11161:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c51c0030800/0xcbad34b281570dab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbad34b281570da4 expref: 18 pid: 5837 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710805.993917:0:11161:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51d032ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11161:1877696177029120:0@lo:104: 00000100:00100000:3.0:1790710805.993951:0:11161:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790710805.993986:0:11161:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c51c6481200/0xcbad34b281570d9d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbad34b281570d96 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710805.994004:0:11161:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c51c6481200/0xcbad34b281570d9d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbad34b281570d96 expref: 18 pid: 5837 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710805.994013:0:11161:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c75de300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11161:1877696177029248:0@lo:104: 00000100:00100000:3.0:1790710805.994043:0:11161:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790710805.994061:0:11161:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c51c0030c00/0xcbad34b281570d8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.46@tcp remote: 0x566877b057000360 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710805.994070:0:11161:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c51c0030c00/0xcbad34b281570d8f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000360 expref: 12 pid: 5838 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710805.994078:0:11161:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c75dc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11161:1877696177029376:192.168.206.46@tcp:104: 00000100:00100000:3.0:1790710805.994102:0:11161:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f50ba900 going to sleep for 11 seconds 00000100:00100000:0.0:1790710805.994109:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177028992 00000100:00100000:0.0:1790710805.994117:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177028992 00000100:00100000:0.0:1790710805.994178:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177029120 00000100:00100000:0.0:1790710805.994180:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177029120 00000100:00100000:0.0:1790710805.994190:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177029248 00000100:00100000:0.0:1790710805.994192:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177029248 00000100:00100000:2.0:1790710805.994201:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790710805.994555:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d032ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5d27fc27-b651-404a-bd8c-b798806fb18a+5:11161:x1877696177028992:12345-0@lo:104: 00010000:00010000:2.0:1790710805.994569:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.146@tcp lock: ffff9c51c1645200/0xcbad34b281570db2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbad34b281570db9 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710805.994633:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790710805.994638:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d032ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5d27fc27-b651-404a-bd8c-b798806fb18a+5:11161:x1877696177028992:12345-0@lo:104: Request processed in 429us (842us total) trans 0 rc 0/0 00010000:00010000:1.0:1790710805.994672:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790710805.994680:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.146@tcp lock: ffff9c51c1645200/0xcbad34b281570db2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbad34b281570db9 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710805.994688:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c1645200 already unused, calling callback (ffffffffc1cdfc20) 10000000:00010000:1.0:1790710805.994692:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.146@tcp lock: ffff9c51c1645200/0xcbad34b281570db2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbad34b281570db9 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710805.994701:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.146@tcp lock: ffff9c51c1645200/0xcbad34b281570db2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbad34b281570db9 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790710805.994709:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.146@tcp lock: ffff9c51c1645200/0xcbad34b281570db2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbad34b281570db9 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790710805.994714:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790710805.994743:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.146@tcp lock: ffff9c51c1645200/0xcbad34b281570db2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281570db9 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710805.994749:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790710805.994771:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.146@tcp lock: ffff9c51c1645200/0xcbad34b281570db2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281570db9 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710805.994772:0:11161:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51d032c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11161:1877696177028992:0@lo:104: 00010000:00010000:1.0:1790710805.994795:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.146@tcp lock: ffff9c51c1645200/0xcbad34b281570db2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281570db9 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710805.994806:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790710805.994808:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790710805.994809:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790710805.994828:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9b04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d27fc27-b651-404a-bd8c-b798806fb18a:3309:1877696177029504:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790710805.994858:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710805.994902:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177029504 00000100:00100000:3.0:1790710805.994907:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177029504 00010000:00010000:3.0:1790710805.994930:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c51c0030000/0xcbad34b281570db9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbad34b281570db2 expref: 19 pid: 5838 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710805.994960:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790710805.994967:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c7cdf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d27fc27-b651-404a-bd8c-b798806fb18a+19:3309:x1877696177029504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790710805.994977:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790710805.994982:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c51c0030000/0xcbad34b281570db9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbad34b281570db2 expref: 19 pid: 5838 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710805.994991:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c51c0030000/0xcbad34b281570db9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbad34b281570db2 expref: 19 pid: 5838 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710805.995014:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c51c0030000/0xcbad34b281570db9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbad34b281570db2 expref: 19 pid: 5838 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710805.995025:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790710805.995063:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c7cdf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d27fc27-b651-404a-bd8c-b798806fb18a+18:3309:x1877696177029504:12345-0@lo:103:ldlm_bl.0 Request processed in 96us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710805.995071:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790710805.995079:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9b04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d27fc27-b651-404a-bd8c-b798806fb18a:3309:1877696177029504:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790710805.997653:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790710805.997698:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790710805.997710:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c75df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5d27fc27-b651-404a-bd8c-b798806fb18a+4:11161:x1877696177029120:12345-0@lo:104: 00010000:00010000:2.0:1790710805.997729:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.146@tcp lock: ffff9c51c0031a00/0xcbad34b281570da4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbad34b281570dab expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710805.998146:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790710805.998154:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c75df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5d27fc27-b651-404a-bd8c-b798806fb18a+4:11161:x1877696177029120:12345-0@lo:104: Request processed in 448us (4201us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710805.998161:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790710805.998177:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790710805.998185:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c75dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5d27fc27-b651-404a-bd8c-b798806fb18a+3:11161:x1877696177029248:12345-0@lo:104: 00010000:00010000:2.0:1790710805.998194:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.146@tcp lock: ffff9c51c8046800/0xcbad34b281570d96 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbad34b281570d9d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710805.998526:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790710805.998533:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.146@tcp lock: ffff9c51c0031a00/0xcbad34b281570da4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbad34b281570dab expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710805.998541:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c0031a00 already unused, calling callback (ffffffffc1cdfc20) 10000000:00010000:0.0:1790710805.998545:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.146@tcp lock: ffff9c51c0031a00/0xcbad34b281570da4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbad34b281570dab expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710805.998554:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.146@tcp lock: ffff9c51c0031a00/0xcbad34b281570da4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbad34b281570dab expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790710805.998561:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.146@tcp lock: ffff9c51c0031a00/0xcbad34b281570da4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbad34b281570dab expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790710805.998575:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790710805.998618:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.146@tcp lock: ffff9c51c0031a00/0xcbad34b281570da4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281570dab expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710805.998625:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790710805.998643:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.146@tcp lock: ffff9c51c0031a00/0xcbad34b281570da4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281570dab expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710805.998650:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.146@tcp lock: ffff9c51c0031a00/0xcbad34b281570da4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281570dab expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710805.998664:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790710805.998666:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790710805.998667:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710805.999586:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790710805.999597:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c75dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5d27fc27-b651-404a-bd8c-b798806fb18a+3:11161:x1877696177029248:12345-0@lo:104: Request processed in 1411us (5551us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710805.999605:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710805.999611:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1790710805.999642:0:8509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1790710805.999642:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00010000:00010000:2.0:1790710805.999649:0:8509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.146@tcp lock: ffff9c51c8046800/0xcbad34b281570d96 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbad34b281570d9d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710805.999658:0:8509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c8046800 already unused, calling callback (ffffffffc1cdfc20) 10000000:00010000:2.0:1790710805.999663:0:8509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.146@tcp lock: ffff9c51c8046800/0xcbad34b281570d96 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbad34b281570d9d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710805.999672:0:8509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.146@tcp lock: ffff9c51c8046800/0xcbad34b281570d96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbad34b281570d9d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790710805.999692:0:8509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.146@tcp lock: ffff9c51c8046800/0xcbad34b281570d96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbad34b281570d9d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710805.999692:0:8449:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158120576 10000000:01000000:2.0:1790710805.999701:0:8509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1790710805.999702:0:8449:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158120576 00010000:00010000:2.0:1790710805.999727:0:8509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.146@tcp lock: ffff9c51c8046800/0xcbad34b281570d96 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281570d9d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710805.999733:0:8449:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c51c1645800/0xcbad34b281570dce lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000398 expref: 13 pid: 5837 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710805.999735:0:8509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790710805.999759:0:8509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.146@tcp lock: ffff9c51c8046800/0xcbad34b281570d96 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281570d9d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710805.999762:0:8449:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158120704 00000100:00100000:1.0:1790710805.999768:0:8449:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158120704 00010000:00010000:2.0:1790710805.999771:0:8509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.146@tcp lock: ffff9c51c8046800/0xcbad34b281570d96 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281570d9d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710805.999784:0:8449:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c51c0030c00/0xcbad34b281570d8f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000360 expref: 14 pid: 5838 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710805.999788:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710805.999792:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710805.999795:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790710805.999811:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 26 00000100:00100000:1.0:1790710805.999820:0:8449:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9b04e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b75d7a5-152f-4db9-bf19-5fe279a322e3+14:2359:x1877696158120576:12345-192.168.206.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790710805.999833:0:8449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790710805.999839:0:8449:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c51c1645800/0xcbad34b281570dce lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000398 expref: 14 pid: 5837 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710805.999865:0:8449:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c51c1645800/0xcbad34b281570dce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000398 expref: 14 pid: 5837 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710805.999881:0:8449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790710805.999924:0:8449:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9b04e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b75d7a5-152f-4db9-bf19-5fe279a322e3+14:2359:x1877696158120576:12345-192.168.206.46@tcp:103:ldlm_bl.0 Request processed in 105us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710805.999932:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 26 00000100:00100000:1.0:1790710805.999950:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 27 00000100:00100000:1.0:1790710805.999957:0:8449:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9b07b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b75d7a5-152f-4db9-bf19-5fe279a322e3+13:2358:x1877696158120704:12345-192.168.206.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790710805.999965:0:8449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790710805.999971:0:8449:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c51c0030c00/0xcbad34b281570d8f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000360 expref: 13 pid: 5838 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710805.999979:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d27fc27-b651-404a-bd8c-b798806fb18a:3311:1877696177029760:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790710805.999984:0:8449:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c51c0030c00/0xcbad34b281570d8f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000360 expref: 13 pid: 5838 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710805.999997:0:8449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790710806.000022:0:8449:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9b07b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b75d7a5-152f-4db9-bf19-5fe279a322e3+13:2358:x1877696158120704:12345-192.168.206.46@tcp:103:ldlm_bl.0 Request processed in 65us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710806.000029:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 27 00000100:00100000:2.0:1790710806.000039:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790710806.000261:0:11161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c51c1645800/0xcbad34b281570dce lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000398 expref: 12 pid: 5837 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710806.000274:0:11161:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51d032df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11161:1877696177028864:192.168.206.46@tcp:104: 00000100:00100000:1.0:1790710806.000282:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177029760 00000100:00100000:1.0:1790710806.000288:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177029760 00000100:00100000:3.0:1790710806.000303:0:11161:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51d032ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11161:1877696177029120:0@lo:104: 00010000:00010000:1.0:1790710806.000308:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c51c6481200/0xcbad34b281570d9d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbad34b281570d96 expref: 18 pid: 5837 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710806.000326:0:11161:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c75de300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11161:1877696177029248:0@lo:104: 00010000:00010000:3.0:1790710806.000336:0:11161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c51c0030c00/0xcbad34b281570d8f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000360 expref: 11 pid: 5838 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710806.000345:0:11161:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c75dc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11161:1877696177029376:192.168.206.46@tcp:104: 00010000:00010000:3.0:1790710806.000371:0:11161:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c51c1645e00/0xcbad34b281570dea lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710806.000446:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1790710806.000454:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d61500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d27fc27-b651-404a-bd8c-b798806fb18a+18:3311:x1877696177029760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790710806.000483:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790710806.000488:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c51c6481200/0xcbad34b281570d9d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbad34b281570d96 expref: 18 pid: 5837 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710806.000497:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c51c6481200/0xcbad34b281570d9d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbad34b281570d96 expref: 18 pid: 5837 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710806.000508:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c51c6481200/0xcbad34b281570d9d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbad34b281570d96 expref: 18 pid: 5837 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710806.000517:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790710806.000560:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d61500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d27fc27-b651-404a-bd8c-b798806fb18a+17:3311:x1877696177029760:12345-0@lo:103:ldlm_bl.0 Request processed in 106us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710806.000567:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790710806.000595:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d27fc27-b651-404a-bd8c-b798806fb18a:3311:1877696177029760:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790710806.001865:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9577b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d27fc27-b651-404a-bd8c-b798806fb18a:3310:1877696177029632:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790710806.001907:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710806.001956:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177029632 00000100:00100000:2.0:1790710806.001963:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177029632 00010000:00010000:2.0:1790710806.001988:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c51c0030800/0xcbad34b281570dab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbad34b281570da4 expref: 17 pid: 5837 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710806.002018:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790710806.002026:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9b05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d27fc27-b651-404a-bd8c-b798806fb18a+17:3310:x1877696177029632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790710806.002036:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790710806.002048:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c51c0030800/0xcbad34b281570dab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbad34b281570da4 expref: 17 pid: 5837 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710806.002058:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c51c0030800/0xcbad34b281570dab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbad34b281570da4 expref: 17 pid: 5837 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710806.002071:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c51c0030800/0xcbad34b281570dab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbad34b281570da4 expref: 17 pid: 5837 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710806.002085:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c51c1645e00/0xcbad34b281570dea lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710806.002093:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c51c1645e00/0xcbad34b281570dea lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710806.002105:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c51c1645e00/0xcbad34b281570dea lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710806.002111:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c51c1645e00/0xcbad34b281570dea lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710806.002117:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c51c1645e00/0xcbad34b281570dea lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710806.002123:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c51c1645e00/0xcbad34b281570dea lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710806.002143:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c1645e00 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:2.0:1790710806.002147:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c51c1645e00/0xcbad34b281570dea lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710806.002155:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c51c1645e00/0xcbad34b281570dea lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710806.002175:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c51c1645e00/0xcbad34b281570dea lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710806.002184:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790710806.002222:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9b05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d27fc27-b651-404a-bd8c-b798806fb18a+16:3310:x1877696177029632:12345-0@lo:103:ldlm_bl.0 Request processed in 196us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710806.002229:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790710806.002694:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9577b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d27fc27-b651-404a-bd8c-b798806fb18a:3310:1877696177029632:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790710806.002730:0:11161:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c51c1645e00/0xcbad34b281570dea lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710806.002739:0:11161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c51c1645e00/0xcbad34b281570dea lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710806.002746:0:11161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c51c1645e00/0xcbad34b281570dea lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710806.037001:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790710807.053176:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1790710807.828304:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790710807.828311:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c51ff4b3000 from 7 10000000:01000000:3.0:1790710807.828315:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790710807.828370:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c1645e00/0xcbad34b281570df1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710807.828382:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.146@tcp lock: ffff9c51c1645e00/0xcbad34b281570df1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710807.828396:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.146@tcp lock: ffff9c51c1645e00/0xcbad34b281570df1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710807.828426:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c75dc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177029888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790710807.828525:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710807.828576:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c8e73300 going to sleep for 11 seconds 00000100:00100000:2.0:1790710807.830624:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177029888 00000100:00100000:2.0:1790710807.830643:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177029888 00000100:00100000:2.0:1790710807.830714:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1790710807.830724:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ee789c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+16:5842:x1877696177029888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790710807.830745:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790710807.830768:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c51c8046800/0xcbad34b281570df8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbad34b281570df1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710807.830798:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c51c8046800/0xcbad34b281570df8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbad34b281570df1 expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710807.830811:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c51c8046800/0xcbad34b281570df8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281570df1 expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710807.830820:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c8046800, rc 0) 00000100:00100000:2.0:1790710807.830924:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ee789c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+17:5842:x1877696177029888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 201us (2398us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710807.830932:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1790710807.831512:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c75dc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177029888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790710807.831535:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.146@tcp lock: ffff9c51c1645e00/0xcbad34b281570df1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570df8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710807.831547:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.146@tcp lock: ffff9c51c1645e00/0xcbad34b281570df1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbad34b281570df8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710807.831636:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c75dc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177030016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790710807.831684:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710807.831721:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c8e73300 going to sleep for 11 seconds 00000100:00100000:3.0:1790710807.831738:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177030016 00000100:00100000:3.0:1790710807.831742:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177030016 00000100:00100000:3.0:1790710807.831784:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1790710807.831805:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8ff8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+17:5842:x1877696177030016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790710807.834976:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8ff8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+17:5842:x1877696177030016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 3159us (3279us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710807.835064:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1790710807.835230:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c75dc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177030016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790710807.835290:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c75dc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177030144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790710807.837583:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710807.837639:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f50ba780 going to sleep for 11 seconds 00000100:00100000:3.0:1790710807.837669:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177030144 00000100:00100000:3.0:1790710807.837677:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177030144 00000100:00100000:3.0:1790710807.837732:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1790710807.837742:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8ff8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+17:5842:x1877696177030144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790710807.840728:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8ff8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+17:5842:x1877696177030144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2976us (3142us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710807.843049:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1790710807.843530:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c75dc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177030144:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1790710807.847046:0:11187:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1790710807.847167:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1790710807.847201:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790710807.847225:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c1645e00/0xcbad34b281570df1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570df8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710807.847237:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.146@tcp lock: ffff9c51c1645e00/0xcbad34b281570df1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570df8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790710807.847249:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790710807.847252:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c51f444d000 from 7 10000000:01000000:3.0:1790710807.847255:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790710807.847300:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c1645800/0xcbad34b281570dff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710807.847316:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.146@tcp lock: ffff9c51c1645800/0xcbad34b281570dff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710807.847330:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.146@tcp lock: ffff9c51c1645800/0xcbad34b281570dff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710807.847372:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c75de300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177030272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790710807.847468:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710807.847521:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f50bad80 going to sleep for 11 seconds 00000100:00100000:1.0:1790710807.848075:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177030272 00000100:00100000:1.0:1790710807.848085:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177030272 00000100:00100000:1.0:1790710807.848165:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1790710807.848176:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8ffa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+17:5842:x1877696177030272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790710807.848194:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790710807.848212:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c51c6480800/0xcbad34b281570e06 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbad34b281570dff expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710807.848240:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c51c6480800/0xcbad34b281570e06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbad34b281570dff expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710807.848263:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c51c6480800/0xcbad34b281570e06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281570dff expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710807.848272:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c6480800, rc 0) 00000100:00100000:1.0:1790710807.848467:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8ffa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+18:5842:x1877696177030272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 283us (989us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710807.848474:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1790710807.848495:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c75de300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177030272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790710807.848514:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.146@tcp lock: ffff9c51c1645800/0xcbad34b281570dff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570e06 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710807.850185:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.146@tcp lock: ffff9c51c1645800/0xcbad34b281570dff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbad34b281570e06 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710807.850319:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d63800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177030400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790710807.850587:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710807.850645:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51ff9fa600 going to sleep for 11 seconds 00000100:00100000:3.0:1790710807.850852:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177030400 00000100:00100000:3.0:1790710807.850862:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177030400 00000100:00100000:3.0:1790710807.850918:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1790710807.850929:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8ff9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+18:5842:x1877696177030400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790710807.852676:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8ff9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+18:5842:x1877696177030400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1739us (2079us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710807.852690:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1790710807.852990:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d63800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177030400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790710807.853058:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d63800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177030528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790710807.853143:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710807.853180:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51ff9fa600 going to sleep for 11 seconds 00000100:00100000:3.0:1790710807.853561:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177030528 00000100:00100000:3.0:1790710807.853570:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177030528 00000100:00100000:3.0:1790710807.853627:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1790710807.853637:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8ff9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+18:5842:x1877696177030528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790710807.857684:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8ff9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+18:5842:x1877696177030528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 4037us (4547us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710807.857701:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1790710807.858951:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d63800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177030528:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1790710807.860370:0:11188:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1790710807.860568:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1790710807.860594:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790710807.860610:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c1645800/0xcbad34b281570dff lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570e06 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710807.860638:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.146@tcp lock: ffff9c51c1645800/0xcbad34b281570dff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570e06 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790710807.860650:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790710807.860653:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c51c67ea000 from 7 10000000:01000000:3.0:1790710807.860656:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790710807.860700:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c1645400/0xcbad34b281570e0d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710807.860707:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.146@tcp lock: ffff9c51c1645400/0xcbad34b281570e0d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710807.860719:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.146@tcp lock: ffff9c51c1645400/0xcbad34b281570e0d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710807.860747:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c75ddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177030656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790710807.860832:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710807.860880:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f50ba900 going to sleep for 11 seconds 00000100:00100000:2.0:1790710807.868238:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177030656 00000100:00100000:2.0:1790710807.868259:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177030656 00000100:00100000:2.0:1790710807.868331:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1790710807.868353:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8ffb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+18:5842:x1877696177030656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790710807.868375:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790710807.868400:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c51c8046a00/0xcbad34b281570e14 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbad34b281570e0d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710807.868435:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c51c8046a00/0xcbad34b281570e14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbad34b281570e0d expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710807.868448:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c51c8046a00/0xcbad34b281570e14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281570e0d expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710807.868488:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c8046a00, rc 0) 00000100:00100000:2.0:1790710807.868584:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8ffb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+19:5842:x1877696177030656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 244us (7752us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710807.868592:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1790710807.870641:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c75ddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177030656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790710807.870673:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.146@tcp lock: ffff9c51c1645400/0xcbad34b281570e0d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570e14 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710807.870687:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.146@tcp lock: ffff9c51c1645400/0xcbad34b281570e0d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbad34b281570e14 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710807.870787:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c75ddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177030784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790710807.870856:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710807.870920:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f50ba900 going to sleep for 11 seconds 00000100:00100000:2.0:1790710807.872266:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177030784 00000100:00100000:2.0:1790710807.872292:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177030784 00000100:00100000:2.0:1790710807.872364:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1790710807.872375:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8ff9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+19:5842:x1877696177030784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790710807.872741:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8ff9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+19:5842:x1877696177030784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 367us (1884us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710807.872750:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1790710807.874562:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c75ddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177030784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790710807.874645:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c75ddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177030912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790710807.874745:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710807.874798:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f50ba900 going to sleep for 11 seconds 00000100:00100000:2.0:1790710807.875273:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177030912 00000100:00100000:2.0:1790710807.875283:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177030912 00000100:00100000:2.0:1790710807.875339:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1790710807.875361:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8ff8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+19:5842:x1877696177030912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790710807.875617:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8ff8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+19:5842:x1877696177030912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 256us (870us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710807.875624:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1790710807.875654:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c75ddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177030912:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1790710807.882886:0:11189:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1790710807.883353:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1790710807.883377:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790710807.883390:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c1645400/0xcbad34b281570e0d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570e14 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710807.883405:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.146@tcp lock: ffff9c51c1645400/0xcbad34b281570e0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570e14 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710808.041778:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710808.041879:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158120832 00000100:00100000:0.0:1790710808.041891:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158120832 00000100:00100000:0.0:1790710808.041964:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 239 00000100:00100000:0.0:1790710808.041976:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8ffb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b75d7a5-152f-4db9-bf19-5fe279a322e3+11:5596:x1877696158120832:12345-192.168.206.46@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790710808.041999:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790710808.042020:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c51c0031800/0xcbad34b281570e1b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x566877b0570003c2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710808.042055:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c51c0031800/0xcbad34b281570e1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570003c2 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710808.042067:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c51c0031800/0xcbad34b281570e1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570003c2 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710808.042096:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c0031800, rc 0) 00000100:00100000:0.0:1790710808.042195:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8ffb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b75d7a5-152f-4db9-bf19-5fe279a322e3+12:5596:x1877696158120832:12345-192.168.206.46@tcp:101:ll_cfg_requeue.0 Request processed in 222us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710808.042203:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 239 00000100:00100000:1.0:1790710808.045858:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710808.045956:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158120960 00000100:00100000:0.0:1790710808.045969:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158120960 00000100:00100000:0.0:1790710808.046042:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 240 00000100:00100000:0.0:1790710808.046054:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8ffac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b75d7a5-152f-4db9-bf19-5fe279a322e3+12:5596:x1877696158120960:12345-192.168.206.46@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790710808.046431:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8ffac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b75d7a5-152f-4db9-bf19-5fe279a322e3+12:5596:x1877696158120960:12345-192.168.206.46@tcp:501:ll_cfg_requeue.0 Request processed in 377us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710808.046440:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 240 00000100:00100000:1.0:1790710808.066363:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710808.066551:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158121088 00000100:00100000:2.0:1790710808.066563:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158121088 00000100:00100000:2.0:1790710808.066624:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 241 00000100:00100000:2.0:1790710808.066634:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8ff8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b75d7a5-152f-4db9-bf19-5fe279a322e3+12:5596:x1877696158121088:12345-192.168.206.46@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790710808.066897:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8ff8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b75d7a5-152f-4db9-bf19-5fe279a322e3+12:5596:x1877696158121088:12345-192.168.206.46@tcp:503:ll_cfg_requeue.0 Request processed in 264us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710808.066907:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 241 00010000:00010000:3.0:1790710808.076684:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790710808.116654:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710808.116924:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158121216 00000100:00100000:3.0:1790710808.116937:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158121216 00000100:00100000:3.0:1790710808.117004:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 242 00000100:00100000:3.0:1790710808.117015:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8ff9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b75d7a5-152f-4db9-bf19-5fe279a322e3+12:5596:x1877696158121216:12345-192.168.206.46@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790710808.117036:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790710808.117057:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c51c1644a00/0xcbad34b281570e22 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x566877b0570003c9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710808.117092:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c51c1644a00/0xcbad34b281570e22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570003c9 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710808.117104:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c51c1644a00/0xcbad34b281570e22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570003c9 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710808.117115:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c1644a00, rc 0) 00000100:00100000:3.0:1790710808.118957:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8ff9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b75d7a5-152f-4db9-bf19-5fe279a322e3+13:5596:x1877696158121216:12345-192.168.206.46@tcp:101:ll_cfg_requeue.0 Request processed in 1931us (2305us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710808.118970:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 242 00000100:00100000:0.0:1790710808.159447:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710808.159510:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158121344 00000100:00100000:0.0:1790710808.161239:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158121344 00000100:00100000:0.0:1790710808.161343:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 243 00000100:00100000:0.0:1790710808.161355:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8ffbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b75d7a5-152f-4db9-bf19-5fe279a322e3+13:5596:x1877696158121344:12345-192.168.206.46@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790710808.162064:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8ffbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b75d7a5-152f-4db9-bf19-5fe279a322e3+13:5596:x1877696158121344:12345-192.168.206.46@tcp:501:ll_cfg_requeue.0 Request processed in 628us (2548us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710808.162076:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 243 00000100:00100000:1.0:1790710808.167901:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710808.167948:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158121472 00000100:00100000:1.0:1790710808.167962:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158121472 00000100:00100000:1.0:1790710808.168038:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 244 00000100:00100000:1.0:1790710808.168049:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8ffa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b75d7a5-152f-4db9-bf19-5fe279a322e3+13:5596:x1877696158121472:12345-192.168.206.46@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790710808.168334:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8ffa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b75d7a5-152f-4db9-bf19-5fe279a322e3+13:5596:x1877696158121472:12345-192.168.206.46@tcp:503:ll_cfg_requeue.0 Request processed in 285us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710808.168342:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 244 00010000:00010000:2.0:1790710809.096148:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790710809.355727:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9577b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d27fc27-b651-404a-bd8c-b798806fb18a:3312:1877696177031040:0@lo:400:kworker.0 00000100:00100000:2.0:1790710809.355792:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710809.355884:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177031040 00000100:00100000:3.0:1790710809.355897:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177031040 00000100:00100000:3.0:1790710809.355940:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1790710809.355948:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8ffb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+19:3312:x1877696177031040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790710809.356141:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9575500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877696177031168:0@lo:400:kworker.0 00000100:00100000:1.0:1790710809.356175:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710809.356200:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790710809.356207:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1877696177031296:0@lo:400:kworker.0 00000100:00100000:1.0:1790710809.356230:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710809.359339:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8ffb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+19:3312:x1877696177031040:12345-0@lo:400:kworker.0 Request processed in 3385us (3540us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710809.359353:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1790710809.359409:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177031168 00000100:00100000:3.0:1790710809.359415:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177031168 00000100:00100000:3.0:1790710809.359459:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177031296 00000100:00100000:3.0:1790710809.359463:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177031296 00000100:00100000:3.0:1790710809.359491:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1790710809.359499:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9b04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877696177031168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790710809.359639:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9b04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877696177031168:12345-0@lo:400:kworker.0 Request processed in 139us (3462us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710809.359646:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1790710809.359659:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1790710809.359665:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9b07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877696177031296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790710809.359696:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9b07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877696177031296:12345-0@lo:400:kworker.0 Request processed in 32us (3466us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710809.359703:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:3.0:1790710809.359726:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790710809.359762:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1877696177031296:0@lo:400:kworker.0 00000100:00100000:3.0:1790710809.359775:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9575500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877696177031168:0@lo:400:kworker.0 00000100:00100000:0.0:1790710809.362327:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790710809.362347:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1877696177031680:0@lo:400:kworker.0 00000100:00100000:0.0:1790710809.362405:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710809.362435:0:6696:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177031680 00000100:00100000:3.0:1790710809.362442:0:6696:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177031680 00000100:00080000:0.0:1790710809.362489:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790710809.362510:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1790710809.362588:0:6696:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1877696177031680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790710809.362657:0:6696:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1877696177031680:12345-0@lo:400:kworker.0 Request processed in 72us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710809.362665:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1790710809.363155:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9577b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d27fc27-b651-404a-bd8c-b798806fb18a:3312:1877696177031040:0@lo:400:kworker.0 00000100:00100000:2.0:1790710809.363174:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1877696177031552:0@lo:400:kworker.0 00010000:00080000:0.0:1790710809.367663:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51f4d64a80 x1877696177031680/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790710825 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790710809.367683:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1877696177031680:0@lo:400:kworker.0 00000100:00100000:3.0:1790710809.368635:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177031424:0@lo:400:kworker.0 00000100:00100000:3.0:1790710809.368708:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710809.368808:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177031424 00000100:00100000:0.0:1790710809.368816:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177031424 00000100:00100000:0.0:1790710809.368912:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1790710809.368924:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c75ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1877696177031424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790710809.368982:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c75ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1877696177031424:12345-0@lo:400:kworker.0 Request processed in 62us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710809.368989:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:0.0:1790710809.369022:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51f4d66300 x1877696177031424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790710825 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790710809.369033:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177031424:0@lo:400:kworker.0 00000100:00080000:3.0:1790710809.369759:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790710809.372441:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710809.373679:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177031552 00000100:00100000:1.0:1790710809.373690:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177031552 00000100:00100000:1.0:1790710809.373762:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1790710809.373772:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1877696177031552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790710809.373833:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1877696177031552:12345-0@lo:400:kworker.0 Request processed in 63us (1396us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710809.373840:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:2.0:1790710809.376969:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790710809.377174:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1877696177031552:0@lo:400:kworker.0 00000100:00100000:2.0:1790710809.863618:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790710809.863640:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1877696177031808:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790710809.863707:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710809.863780:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177031808 00000100:00100000:2.0:1790710809.863788:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177031808 00000100:00100000:2.0:1790710809.863833:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790710809.863842:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877696177031808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790710809.864441:0:6699:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790710809.864658:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877696177031808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 817us (950us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710809.864666:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1790710809.864942:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51f4d61180 x1877696177031808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790710825 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790710809.864962:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1877696177031808:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1790710810.119289:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790710810.378780:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9b05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177031936:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790710810.378959:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710810.379694:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177031936 00000100:00100000:3.0:1790710810.379706:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177031936 00000100:00100000:3.0:1790710810.379787:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790710810.379801:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9b05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877696177031936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790710810.379851:0:6699:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790710810.379934:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9b05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877696177031936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 137us (975us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710810.379942:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:2.0:1790710810.385289:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51f9b05180 x1877696177031936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790710826 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790710810.385316:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9b05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177031936:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790710810.590770:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710810.590814:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710810.590839:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710810.590873:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158121728 00000100:00100000:2.0:1790710810.590885:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158121728 00000100:00100000:2.0:1790710810.590950:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158121856 00000100:00100000:2.0:1790710810.590953:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158121856 00000100:00100000:2.0:1790710810.590978:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 92 00000100:00100000:2.0:1790710810.590988:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:2357:x1877696158121728:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:2.0:1790710810.591077:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:2357:x1877696158121728:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 90us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710810.591086:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 92 00000100:00100000:2.0:1790710810.591108:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 93 00000100:00100000:2.0:1790710810.591114:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1b59f23d-9a5c-439d-bd4a-453bf2315b97+5:2357:x1877696158121856:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:2.0:1790710810.591166:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1b59f23d-9a5c-439d-bd4a-453bf2315b97+5:2357:x1877696158121856:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 51us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710810.591173:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 93 00000100:00100000:2.0:1790710810.591195:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158121600 00000100:00100000:2.0:1790710810.591198:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158121600 00000100:00100000:2.0:1790710810.591226:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 246 00000100:00100000:2.0:1790710810.591239:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8ffa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b75d7a5-152f-4db9-bf19-5fe279a322e3+13:2357:x1877696158121600:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:2.0:1790710810.591267:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8ffa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b75d7a5-152f-4db9-bf19-5fe279a322e3+13:2357:x1877696158121600:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 29us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710810.591273:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 246 00000100:00080000:2.0:1790710810.591308:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:1.0:1790710811.082180:0:11358:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg646-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1790710811.146210:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710812.169882:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790710813.192909:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790710814.216070:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790710814.472919:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877696177032192:0@lo:400:kworker.0 00000100:00100000:3.0:1790710814.472985:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710814.473052:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1877696177032704:0@lo:400:kworker.0 00000100:00100000:3.0:1790710814.473078:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710814.473109:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790710814.473115:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1877696177032320:0@lo:400:kworker.0 00000100:00100000:3.0:1790710814.473160:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710814.473189:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177032704 00000100:00100000:3.0:1790710814.473196:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177032704 00000100:00100000:3.0:1790710814.473244:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1790710814.473252:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c75ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1877696177032704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790710814.473317:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c75ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1877696177032704:12345-0@lo:400:kworker.0 Request processed in 65us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710814.473325:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:3.0:1790710814.473366:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51f4d65f80 x1877696177032704/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790710830 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790710814.473379:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1877696177032704:0@lo:400:kworker.0 00000100:00100000:2.0:1790710814.473476:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177032448:0@lo:400:kworker.0 00000100:00100000:2.0:1790710814.473507:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710814.473540:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1790710814.473546:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d27fc27-b651-404a-bd8c-b798806fb18a:3311:1877696177032064:0@lo:400:kworker.0 00000100:00100000:2.0:1790710814.473574:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710814.473594:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1877696177032576:0@lo:400:kworker.0 00000100:00100000:2.0:1790710814.473629:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710814.473662:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177032192 00000100:00100000:2.0:1790710814.473666:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177032192 00000100:00100000:2.0:1790710814.473693:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177032320 00000100:00100000:2.0:1790710814.473696:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177032320 00000100:00100000:2.0:1790710814.473710:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177032576 00000100:00100000:2.0:1790710814.473713:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177032576 00000100:00100000:2.0:1790710814.473726:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1790710814.473732:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c75dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877696177032192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790710814.473767:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c75dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877696177032192:12345-0@lo:400:kworker.0 Request processed in 34us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710814.473773:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1790710814.473789:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1790710814.473795:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c75dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877696177032320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790710814.473832:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c75dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877696177032320:12345-0@lo:400:kworker.0 Request processed in 38us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710814.473839:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1790710814.473852:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1790710814.473858:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f3e75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1877696177032576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790710814.473888:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f3e75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1877696177032576:12345-0@lo:400:kworker.0 Request processed in 30us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710814.473893:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:2.0:1790710814.473910:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790710814.473913:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790710814.473937:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1877696177032576:0@lo:400:kworker.0 00000100:00100000:0.0:1790710814.475600:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177032448 00000100:00100000:0.0:1790710814.475611:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177032448 00000100:00100000:0.0:1790710814.475680:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1790710814.475689:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1877696177032448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790710814.475759:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1877696177032448:12345-0@lo:400:kworker.0 Request processed in 71us (2251us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710814.475766:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:0.0:1790710814.475806:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51f4d65500 x1877696177032448/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790710830 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790710814.475818:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177032448:0@lo:400:kworker.0 00000100:00100000:3.0:1790710814.476573:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177032064 00000100:00100000:3.0:1790710814.476580:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177032064 00000100:00100000:3.0:1790710814.476624:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1790710814.476632:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ee72a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+19:3311:x1877696177032064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790710814.476679:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ee72a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+19:3311:x1877696177032064:12345-0@lo:400:kworker.0 Request processed in 48us (3103us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710814.476685:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1790710814.476729:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1877696177032320:0@lo:400:kworker.0 00000100:00100000:3.0:1790710814.476741:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877696177032192:0@lo:400:kworker.0 00000100:00100000:0.0:1790710814.477001:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d27fc27-b651-404a-bd8c-b798806fb18a:3311:1877696177032064:0@lo:400:kworker.0 00000100:00080000:2.0:1790710814.477256:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790710814.990582:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790710814.990606:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f3e74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1877696177032832:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790710814.990670:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710814.990810:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177032832 00000100:00100000:2.0:1790710814.990819:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177032832 00000100:00100000:2.0:1790710814.990869:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1790710814.990878:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c75dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877696177032832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790710814.990912:0:6699:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790710814.990966:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c75dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877696177032832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710814.990973:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:0.0:1790710814.993200:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51f3e74a80 x1877696177032832/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790710830 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790710814.993238:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f3e74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1877696177032832:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1790710815.244225:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790710815.495642:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790710815.495673:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9b04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1877696177032960:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790710815.495774:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710815.496072:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177032960 00000100:00100000:2.0:1790710815.496083:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177032960 00000100:00100000:2.0:1790710815.496170:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790710815.496182:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9b06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877696177032960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790710815.496230:0:6699:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790710815.496316:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9b06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877696177032960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 135us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710815.496341:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:2.0:1790710815.496393:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51f9b04380 x1877696177032960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790710831 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790710815.496424:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9b04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1877696177032960:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790710815.712779:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710815.712835:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710815.712875:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710815.712910:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158122240 00000100:00100000:0.0:1790710815.712922:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158122240 00000100:00100000:0.0:1790710815.712994:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158122112 00000100:00100000:0.0:1790710815.712997:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158122112 00000100:00100000:0.0:1790710815.713028:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 97 00000100:00100000:0.0:1790710815.713039:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1b59f23d-9a5c-439d-bd4a-453bf2315b97+5:2357:x1877696158122240:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:0.0:1790710815.713169:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1b59f23d-9a5c-439d-bd4a-453bf2315b97+5:2357:x1877696158122240:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 131us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710815.713177:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 97 00000100:00100000:0.0:1790710815.713196:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 98 00000100:00100000:0.0:1790710815.713203:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:2357:x1877696158122112:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:0.0:1790710815.713230:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:2357:x1877696158122112:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 27us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710815.713236:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 98 00000100:00100000:2.0:1790710815.713961:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158121984 00000100:00100000:2.0:1790710815.713971:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158121984 00000100:00100000:2.0:1790710815.714024:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 248 00000100:00100000:2.0:1790710815.714033:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ee72a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b75d7a5-152f-4db9-bf19-5fe279a322e3+13:2357:x1877696158121984:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:2.0:1790710815.714093:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ee72a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b75d7a5-152f-4db9-bf19-5fe279a322e3+13:2357:x1877696158121984:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 62us (1340us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710815.714100:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 248 00000100:00080000:2.0:1790710815.714164:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:1.0:1790710816.126064:0:11458:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 15:40:13 (1790710813) === 00010000:00010000:1.0:1790710816.263859:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790710816.333995:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710816.334029:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710816.334063:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158122368 00000100:00100000:3.0:1790710816.334072:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158122368 00000100:00100000:3.0:1790710816.334140:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 14 00000100:00100000:3.0:1790710816.334150:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c75dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:2358:x1877696158122368:12345-192.168.206.46@tcp:41:mkdir.0 00000004:00000024:3.0:1790710816.334197:0:5847:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1790710816.334277:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c75dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:2358:x1877696158122368:12345-192.168.206.46@tcp:41:mkdir.0 Request processed in 127us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710816.334284:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 14 00000100:00100000:0.0:1790710816.334442:0:5854:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158122496 00000100:00100000:0.0:1790710816.334447:0:5854:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158122496 00000100:00100000:0.0:1790710816.334478:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 0 00000100:00100000:0.0:1790710816.334486:0:5854:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c75dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:9663:x1877696158122496:12345-192.168.206.46@tcp:700:mkdir.0 00000100:00100000:0.0:1790710816.334521:0:5854:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c75dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:9663:x1877696158122496:12345-192.168.206.46@tcp:700:mkdir.0 Request processed in 36us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710816.334536:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 0 00000100:00100000:0.0:1790710816.349194:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710816.349226:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158122752 00000100:00100000:0.0:1790710816.349244:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158122752 00000100:00100000:0.0:1790710816.349292:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 15 00000100:00100000:0.0:1790710816.349301:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:9663:x1877696158122752:12345-192.168.206.46@tcp:36:mkdir.0 00010000:00010000:0.0:1790710816.349351:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790710816.349438:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046c00/0xcbad34b281570d0a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700034b expref: 6 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.349456:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c51cca25200) 00010000:00010000:0.0:1790710816.349466:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790710816.352508:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030200/0xcbad34b281570e29 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.352530:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030200/0xcbad34b281570e29 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.352542:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030200/0xcbad34b281570e29 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.352588:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281570e30 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.352597:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281570e30 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.352604:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281570e30 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790710816.362282:0:5846:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1790710816.362300:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030200/0xcbad34b281570e29 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.362310:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030200/0xcbad34b281570e29 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.362318:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030200/0xcbad34b281570e29 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.362324:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c0030200 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1790710816.362329:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030200/0xcbad34b281570e29 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.362337:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030200/0xcbad34b281570e29 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.362352:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c51e4efba00) 00010000:00010000:0.0:1790710816.362355:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790710816.362360:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030200/0xcbad34b281570e29 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.362367:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030200/0xcbad34b281570e29 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790710816.362385:0:5846:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000d7b47016 reply state 00000000a96d64a7 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281570e30 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710816.362394:0:5846:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790710816.362507:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+7:9663:x1877696158122752:12345-192.168.206.46@tcp:36:mkdir.0 Request processed in 13203us (13315us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1790710816.362524:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 15 00010000:00010000:0.0:1790710816.372223:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281570e30 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.372240:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281570e30 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.372248:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281570e30 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.372254:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c0030000 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1790710816.372258:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281570e30 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.372266:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281570e30 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.372280:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9c51e4efbf00) 00010000:00010000:0.0:1790710816.372283:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790710816.372288:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281570e30 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.372294:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281570e30 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710816.401780:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710816.401923:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158122880 00000100:00100000:3.0:1790710816.401932:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158122880 00000100:00100000:3.0:1790710816.401978:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 16 00000100:00100000:3.0:1790710816.401985:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:9664:x1877696158122880:12345-192.168.206.46@tcp:101:chmod.0 00010000:00010000:3.0:1790710816.402003:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790710816.402022:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281570e37 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b0570003d0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710816.402073:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645000/0xcbad34b281570e3e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710816.402083:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645000/0xcbad34b281570e3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710816.402092:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645000/0xcbad34b281570e3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790710816.402161:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790710816.402165:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790710816.402192:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645000/0xcbad34b281570e3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710816.402210:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281570e37 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570003d0 expref: 8 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710816.402235:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645000/0xcbad34b281570e3e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570003d0 expref: 7 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710816.402241:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c51c2c2e000) 00010000:00010000:3.0:1790710816.402243:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790710816.402245:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c1645000, rc 0) 00000100:00100000:3.0:1790710816.402292:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+7:9664:x1877696158122880:12345-192.168.206.46@tcp:101:chmod.0 Request processed in 308us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710816.402296:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 16 00000100:00100000:3.0:1790710816.405640:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710816.406511:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158123136 00000100:00100000:0.0:1790710816.406520:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158123136 00000100:00100000:0.0:1790710816.406613:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 17 00000100:00100000:0.0:1790710816.406622:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c75df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+7:9664:x1877696158123136:12345-192.168.206.46@tcp:36:chmod.0 00010000:00010000:0.0:1790710816.406684:0:8060:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790710816.406706:0:8060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645000/0xcbad34b281570e3e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570003d0 expref: 7 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.406721:0:8060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c51c2c2e000) 00010000:00010000:0.0:1790710816.406730:0:8060:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790710816.406749:0:8060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281570e45 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.406761:0:8060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281570e45 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.406769:0:8060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281570e45 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790710816.407016:0:8060:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000007113d876 reply state 00000000151389d7 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281570e45 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710816.407024:0:8060:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1790710816.407030:0:8060:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1790710816.407102:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c75df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+8:9664:x1877696158123136:12345-192.168.206.46@tcp:36:chmod.0 Request processed in 481us (1469us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1790710816.407109:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 17 00010000:00010000:3.0:1790710816.421823:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281570e45 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710816.421846:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281570e45 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710816.421854:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281570e45 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710816.421860:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c0030000 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1790710816.421871:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281570e45 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710816.421879:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281570e45 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710816.421893:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c51e4efbf00) 00010000:00010000:3.0:1790710816.421896:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790710816.421919:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281570e45 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710816.421926:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281570e45 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710816.463312:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710816.464102:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158123264 00000100:00100000:0.0:1790710816.464113:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158123264 00000100:00100000:0.0:1790710816.464754:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 18 00000100:00100000:0.0:1790710816.464765:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c75dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+7:9665:x1877696158123264:12345-192.168.206.46@tcp:101:chown.0 00010000:00010000:0.0:1790710816.464790:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790710816.464810:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030200/0xcbad34b281570e4c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b0570003d7 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.464886:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030c00/0xcbad34b281570e53 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.464900:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030c00/0xcbad34b281570e53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.464910:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030c00/0xcbad34b281570e53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790710816.464942:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1790710816.464946:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790710816.464993:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030c00/0xcbad34b281570e53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.465019:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030200/0xcbad34b281570e4c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570003d7 expref: 9 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.465180:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030c00/0xcbad34b281570e53 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570003d7 expref: 8 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.465190:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c51e4efba00) 00010000:00010000:0.0:1790710816.465193:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790710816.465196:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c0030c00, rc 0) 00000100:00100000:0.0:1790710816.465248:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c75dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+8:9665:x1877696158123264:12345-192.168.206.46@tcp:101:chown.0 Request processed in 484us (1943us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710816.465255:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 18 00000100:00100000:2.0:1790710816.469232:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710816.470726:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158123392 00000100:00100000:0.0:1790710816.470738:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158123392 00000100:00100000:0.0:1790710816.470821:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 19 00000100:00100000:0.0:1790710816.470831:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f3e77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+8:9665:x1877696158123392:12345-192.168.206.46@tcp:101:chown.0 00010000:00010000:0.0:1790710816.470849:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790710816.470868:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031600/0xcbad34b281570e5a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b0570003de expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.470928:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030e00/0xcbad34b281570e61 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.470943:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030e00/0xcbad34b281570e61 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.470954:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030e00/0xcbad34b281570e61 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.470969:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281570e68 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.470976:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281570e68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.470983:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281570e68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.471085:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031a00/0xcbad34b281570e6f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.471093:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031a00/0xcbad34b281570e6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.471100:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031a00/0xcbad34b281570e6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790710816.471160:0:5846:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1790710816.471165:0:5846:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790710816.471182:0:5846:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031a00/0xcbad34b281570e6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.471193:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030e00/0xcbad34b281570e61 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.471199:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030e00/0xcbad34b281570e61 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.471206:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030e00/0xcbad34b281570e61 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.471212:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c0030e00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1790710816.471216:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030e00/0xcbad34b281570e61 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.471223:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030e00/0xcbad34b281570e61 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.471234:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c51e4efba00) 00010000:00010000:0.0:1790710816.471237:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790710816.471241:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030e00/0xcbad34b281570e61 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.471247:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030e00/0xcbad34b281570e61 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.471273:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281570e68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.471289:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281570e68 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.471295:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281570e68 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.471300:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c0030000 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1790710816.471303:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281570e68 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.471309:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281570e68 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.471317:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9c51e4efb000) 00010000:00010000:0.0:1790710816.471320:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790710816.471338:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281570e68 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.471345:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281570e68 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.471379:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031600/0xcbad34b281570e5a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570003de expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.471394:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031a00/0xcbad34b281570e6f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570003de expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.471402:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9c51e4efb700) 00010000:00010000:0.0:1790710816.471404:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790710816.472630:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c0031a00, rc 0) 00000100:00100000:0.0:1790710816.472697:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f3e77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+9:9665:x1877696158123392:12345-192.168.206.46@tcp:101:chown.0 Request processed in 1864us (3468us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710816.472705:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 19 00000100:00100000:1.0:1790710816.476650:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710816.476727:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158123648 00000100:00100000:0.0:1790710816.476736:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158123648 00000100:00100000:0.0:1790710816.476793:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 20 00000100:00100000:0.0:1790710816.476803:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9b07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+9:9665:x1877696158123648:12345-192.168.206.46@tcp:36:chown.0 00010000:00010000:0.0:1790710816.476852:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790710816.476878:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031a00/0xcbad34b281570e6f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570003de expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.476897:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9c51e4efb700) 00010000:00010000:0.0:1790710816.476908:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790710816.476930:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030800/0xcbad34b281570e76 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.476942:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030800/0xcbad34b281570e76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.476951:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030800/0xcbad34b281570e76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790710816.541271:0:5867:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:1.0:1790710816.541318:0:5845:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000095096cfe reply state 000000000cb22092 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030800/0xcbad34b281570e76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710816.541330:0:5845:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1790710816.541343:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00080000:1.0:1790710816.541449:0:5845:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1790710816.541477:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9b07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+7:9665:x1877696158123648:12345-192.168.206.46@tcp:36:chown.0 Request processed in 64672us (64832us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1790710816.541499:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 20 00010000:00010000:0.0:1790710816.541626:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030800/0xcbad34b281570e76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.541636:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030800/0xcbad34b281570e76 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.541644:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030800/0xcbad34b281570e76 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.541656:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c0030800 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1790710816.541661:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030800/0xcbad34b281570e76 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.541668:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030800/0xcbad34b281570e76 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.541681:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9c51e4efb100) 00010000:00010000:0.0:1790710816.541685:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790710816.541689:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030800/0xcbad34b281570e76 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.541695:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030800/0xcbad34b281570e76 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710816.574291:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710816.574384:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158123776 00000100:00100000:0.0:1790710816.574394:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158123776 00000100:00100000:0.0:1790710816.574470:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 21 00000100:00100000:0.0:1790710816.574480:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9b06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:9666:x1877696158123776:12345-192.168.206.46@tcp:101:touch.500 00010000:00010000:0.0:1790710816.574503:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790710816.574522:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030800/0xcbad34b281570e7d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b0570003e5 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790710816.578621:0:5846:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 4045us 00010000:00010000:2.0:1790710816.592577:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b281570e84 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710816.592603:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b281570e84 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710816.592615:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b281570e84 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710816.592631:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b281570e8b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710816.592639:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b281570e8b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710816.592653:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b281570e8b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710816.593065:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b281570e92 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710816.593074:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b281570e92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710816.593080:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b281570e92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790710816.594256:0:5846:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790710816.594263:0:5846:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790710816.594307:0:5846:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b281570e92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710816.594321:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b281570e84 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710816.594329:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b281570e84 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710816.594336:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b281570e84 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710816.594343:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c8047800 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1790710816.594348:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b281570e84 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710816.594356:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b281570e84 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710816.594377:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c51e4efba00) 00010000:00010000:2.0:1790710816.594381:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790710816.594386:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b281570e84 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710816.594393:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b281570e84 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710816.594406:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b281570e8b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710816.594424:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b281570e8b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710816.594431:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b281570e8b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710816.594437:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c8046e00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1790710816.594440:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b281570e8b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710816.594445:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b281570e8b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710816.594455:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9c51cca25f00) 00010000:00010000:2.0:1790710816.594458:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790710816.594461:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b281570e8b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710816.594467:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b281570e8b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710816.594516:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030800/0xcbad34b281570e7d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570003e5 expref: 8 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710816.594531:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b281570e92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570003e5 expref: 7 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710816.594538:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9c51cca25200) 00010000:00010000:2.0:1790710816.594540:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1790710816.594542:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c8047a00, rc 0) 00000100:00100000:2.0:1790710816.594607:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9b06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+7:9666:x1877696158123776:12345-192.168.206.46@tcp:101:touch.500 Request processed in 20128us (20324us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710816.594615:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 21 00000100:00100000:1.0:1790710816.619663:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710816.627287:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158124032 00000100:00100000:2.0:1790710816.627302:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158124032 00000100:00100000:2.0:1790710816.627372:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 22 00000100:00100000:2.0:1790710816.627382:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9b07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+7:9666:x1877696158124032:12345-192.168.206.46@tcp:101:touch.500 00010000:00010000:2.0:1790710816.627402:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790710816.627433:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b281570e99 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b0570003ec expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710816.627689:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b281570ea0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710816.627703:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b281570ea0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710816.627714:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b281570ea0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710816.627780:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047000/0xcbad34b281570ea7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710816.627789:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047000/0xcbad34b281570ea7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710816.627796:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047000/0xcbad34b281570ea7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790710816.628522:0:5847:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:2.0:1790710816.628782:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046c00/0xcbad34b281570eae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710816.628794:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046c00/0xcbad34b281570eae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710816.628802:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046c00/0xcbad34b281570eae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710816.628831:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b281570ea0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710816.628838:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b281570ea0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710816.628844:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b281570ea0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710816.628850:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c8047800 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1790710816.628854:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b281570ea0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710816.628873:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b281570ea0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710816.628885:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9c51cca25200) 00010000:00010000:2.0:1790710816.628888:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790710816.628893:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b281570ea0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710816.628899:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b281570ea0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790710816.628910:0:5847:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000003391dd40 reply state 000000001ce13967 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047000/0xcbad34b281570ea7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710816.628918:0:5847:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1790710816.628947:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b281570e99 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570003ec expref: 10 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710816.628963:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046c00/0xcbad34b281570eae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570003ec expref: 9 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710816.628970:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9c51cca25500) 00010000:00010000:2.0:1790710816.628972:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790710816.628974:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c8046c00, rc 0) 00000100:00100000:2.0:1790710816.629047:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9b07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+10:9666:x1877696158124032:12345-192.168.206.46@tcp:101:touch.500 Request processed in 1667us (9391us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1790710816.629055:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 22 00010000:00010000:0.0:1790710816.638467:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047000/0xcbad34b281570ea7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.638484:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047000/0xcbad34b281570ea7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.638493:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047000/0xcbad34b281570ea7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.638513:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c8047000 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1790710816.638517:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047000/0xcbad34b281570ea7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.638525:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047000/0xcbad34b281570ea7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.638540:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xe219b27a (ffff9c51cca25f00) 00010000:00010000:0.0:1790710816.638543:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790710816.638548:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047000/0xcbad34b281570ea7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.638554:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047000/0xcbad34b281570ea7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710816.640226:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710816.640466:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158124288 00000100:00100000:3.0:1790710816.640475:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158124288 00000100:00100000:3.0:1790710816.640524:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 23 00000100:00100000:3.0:1790710816.640534:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9b06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+9:9666:x1877696158124288:12345-192.168.206.46@tcp:36:touch.500 00010000:00010000:3.0:1790710816.640585:0:8060:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790710816.640606:0:8060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046c00/0xcbad34b281570eae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570003ec expref: 9 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710816.640627:0:8060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9c51cca25500) 00010000:00010000:3.0:1790710816.640636:0:8060:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790710816.640673:0:8060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281570ebc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710816.640685:0:8060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281570ebc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710816.640694:0:8060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281570ebc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790710816.641000:0:8060:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000ba9f43d8 reply state 00000000e044684c transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281570ebc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710816.641010:0:8060:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790710816.641786:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9b06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+10:9666:x1877696158124288:12345-192.168.206.46@tcp:36:touch.500 Request processed in 1250us (1564us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1790710816.641808:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 23 00000100:00100000:2.0:1790710816.653601:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710816.653861:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158124416 00000100:00100000:1.0:1790710816.653871:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158124416 00000100:00100000:1.0:1790710816.653929:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 24 00000100:00100000:1.0:1790710816.653941:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f3e75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+10:9666:x1877696158124416:12345-192.168.206.46@tcp:101:touch.500 00010000:00010000:1.0:1790710816.653975:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790710816.653996:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481400/0xcbad34b281570ec3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b0570003f3 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710816.654062:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481400/0xcbad34b281570ec3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570003f3 expref: 11 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710816.654076:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481400/0xcbad34b281570ec3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570003f3 expref: 11 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710816.654094:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9c51c2c2ea00) 00010000:00010000:1.0:1790710816.654097:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790710816.654100:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c6481400, rc 0) 00000100:00100000:1.0:1790710816.654194:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f3e75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+11:9666:x1877696158124416:12345-192.168.206.46@tcp:101:touch.500 Request processed in 254us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710816.654202:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 24 00010000:00010000:3.0:1790710816.655895:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281570ebc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710816.655910:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281570ebc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710816.655918:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281570ebc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710816.655924:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c1645200 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1790710816.655928:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281570ebc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710816.655936:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281570ebc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710816.655950:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9c51c2c2ea00) 00010000:00010000:3.0:1790710816.655953:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790710816.655957:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281570ebc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710816.655963:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281570ebc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710816.659227:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710816.659528:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158124544 00000100:00100000:2.0:1790710816.659550:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158124544 00000100:00100000:2.0:1790710816.659594:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 16 00000100:00100000:2.0:1790710816.659602:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2355:x1877696158124544:12345-192.168.206.46@tcp:8:touch.500 00010000:00080000:2.0:1790710816.659631:0:6697:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 0ec73bd1-726e-4dc0-8edd-807d3f973d65@192.168.206.46@tcp t0 exp 0000000000000000 cur 293 last 0 00000020:00000080:2.0:1790710816.659666:0:6697:0:(genops.c:1384:class_connect()) connect: client 0ec73bd1-726e-4dc0-8edd-807d3f973d65, cookie 0xcbad34b281570eca 00002000:00100000:2.0:1790710816.659679:0:6697:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0ec73bd1-726e-4dc0-8edd-807d3f973d65/ffff9c51ff96a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790710816.659689:0:6697:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1790710816.659945:0:6697:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1790710816.659973:0:6697:0:(import.c:65:import_set_state_nolock()) ffff9c51ff96b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790710816.660050:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:2355:x1877696158124544:12345-192.168.206.46@tcp:8:touch.500 Request processed in 446us (831us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710816.660057:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 16 00000100:00100000:2.0:1790710816.667527:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710816.667656:0:6696:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158124672 00000100:00100000:3.0:1790710816.667666:0:6696:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158124672 00000100:00100000:3.0:1790710816.667747:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 17 00000100:00100000:3.0:1790710816.667757:0:6696:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f3e75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:0:x1877696158124672:12345-192.168.206.46@tcp:2:touch.500 00000100:00080000:2.0:1790710816.668431:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790710816.777614:0:6696:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f3e75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+7:0:x1877696158124672:12345-192.168.206.46@tcp:2:touch.500 Request processed in 109848us (110085us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1790710816.777638:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 17 00000001:00100000:3.0:1790710816.777669:0:7643:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0ec73bd1-726e-4dc0-8edd-807d3f973d65 00000001:00080000:3.0:1790710816.777681:0:7643:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:2.0:1790710816.785462:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710816.785590:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158124928 00000100:00100000:3.0:1790710816.785600:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158124928 00000100:00100000:3.0:1790710816.785647:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 2 00000100:00100000:3.0:1790710816.785656:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f3e74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+10:9666:x1877696158124928:12345-192.168.206.46@tcp:35:touch.500 00000100:00100000:3.0:1790710816.786085:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f3e74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+11:9666:x1877696158124928:12345-192.168.206.46@tcp:35:touch.500 Request processed in 429us (1386us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1790710816.786092:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 2 00000100:00100000:2.0:1790710816.816544:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710816.816676:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158125056 00000100:00100000:0.0:1790710816.816687:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158125056 00000100:00100000:0.0:1790710816.816748:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 25 00000100:00100000:0.0:1790710816.816759:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f3e76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+11:9667:x1877696158125056:12345-192.168.206.46@tcp:101:rm.0 00010000:00010000:0.0:1790710816.816794:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790710816.816814:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281570ed1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b0570003fa expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.816877:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030e00/0xcbad34b281570ed8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.816891:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030e00/0xcbad34b281570ed8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.816924:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030e00/0xcbad34b281570ed8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790710816.816957:0:5846:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1790710816.816960:0:5846:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790710816.816995:0:5846:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030e00/0xcbad34b281570ed8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.817021:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281570ed1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570003fa expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.817039:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030e00/0xcbad34b281570ed8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570003fa expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.817048:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9c51cca25200) 00010000:00010000:0.0:1790710816.817050:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790710816.817054:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c0030e00, rc 0) 00000100:00100000:0.0:1790710816.817112:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f3e76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+12:9667:x1877696158125056:12345-192.168.206.46@tcp:101:rm.0 Request processed in 356us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710816.817119:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 25 00000100:00100000:2.0:1790710816.825245:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710816.825713:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158125312 00000100:00100000:0.0:1790710816.825723:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158125312 00000100:00100000:0.0:1790710816.825786:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 26 00000100:00100000:0.0:1790710816.825797:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f3e77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+12:9667:x1877696158125312:12345-192.168.206.46@tcp:101:rm.0 00010000:00010000:0.0:1790710816.825815:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790710816.825832:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281570edf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b057000401 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790710816.826186:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1790710816.826563:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281570edf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000401 expref: 14 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.826576:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c51e4efba00) 00010000:00010000:0.0:1790710816.826583:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790710816.826588:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281570edf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000401 expref: 14 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.826602:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c0030000, rc 0) 00000100:00100000:0.0:1790710816.826845:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f3e77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+13:9667:x1877696158125312:12345-192.168.206.46@tcp:101:rm.0 Request processed in 1048us (1607us total) trans 4294967303 rc 301/301 00000100:00100000:0.0:1790710816.826853:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 26 00000100:00100000:2.0:1790710816.833041:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710816.833805:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158125440 00000100:00100000:3.0:1790710816.833819:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158125440 00000100:00100000:3.0:1790710816.833876:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 3 00000100:00100000:3.0:1790710816.833885:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f3e76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+13:9667:x1877696158125440:12345-192.168.206.46@tcp:37:rm.0 00000100:00100000:1.0:1790710816.856450:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f3e76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+13:9667:x1877696158125440:12345-192.168.206.46@tcp:37:rm.0 Request processed in 22557us (23408us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710816.856479:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 3 00000100:00100000:0.0:1790710816.868097:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710816.868567:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158125696 00000100:00100000:3.0:1790710816.868577:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158125696 00000100:00100000:3.0:1790710816.868686:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 4 00000100:00100000:3.0:1790710816.868696:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d6260450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+13:9667:x1877696158125696:12345-192.168.206.46@tcp:35:rm.0 00000100:00100000:3.0:1790710816.869079:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d6260450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+14:9667:x1877696158125696:12345-192.168.206.46@tcp:35:rm.0 Request processed in 383us (990us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1790710816.869087:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 4 00000100:00100000:2.0:1790710816.877499:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710816.878161:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158125952 00000100:00100000:3.0:1790710816.878171:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158125952 00000100:00100000:3.0:1790710816.878219:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 27 00000100:00100000:3.0:1790710816.878228:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f3e77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+14:9667:x1877696158125952:12345-192.168.206.46@tcp:101:rm.0 00010000:00010000:3.0:1790710816.878441:0:8060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790710816.878473:0:8060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b281570eed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b057000408 expref: -99 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710816.878564:0:8060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281570ef4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710816.878579:0:8060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281570ef4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710816.878590:0:8060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281570ef4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790710816.878602:0:8060:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1790710816.878720:0:8060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b281570eed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000408 expref: 17 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710816.878736:0:8060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281570ef4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000408 expref: 16 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710816.878745:0:8060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9c51cca25200) 00010000:00010000:3.0:1790710816.878748:0:8060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790710816.878751:0:8060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c1645200, rc 0) 00000100:00100000:3.0:1790710816.878813:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f3e77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+16:9667:x1877696158125952:12345-192.168.206.46@tcp:101:rm.0 Request processed in 585us (1322us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1790710816.878820:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 27 00000100:00100000:2.0:1790710816.881826:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710816.881904:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158126080 00000100:00100000:1.0:1790710816.881913:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158126080 00000100:00100000:1.0:1790710816.882014:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 28 00000100:00100000:1.0:1790710816.882024:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f3e76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+16:9667:x1877696158126080:12345-192.168.206.46@tcp:41:rm.0 00000004:00000024:1.0:1790710816.882092:0:5847:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:1.0:1790710816.882186:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f3e76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+16:9667:x1877696158126080:12345-192.168.206.46@tcp:41:rm.0 Request processed in 162us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710816.882193:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 28 00000100:00100000:0.0:1790710816.884199:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710816.884475:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158126208 00000100:00100000:2.0:1790710816.884483:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158126208 00000100:00100000:2.0:1790710816.884533:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 29 00000100:00100000:2.0:1790710816.884542:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+16:9667:x1877696158126208:12345-192.168.206.46@tcp:101:rm.0 00010000:00010000:2.0:1790710816.884560:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790710816.884579:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047000/0xcbad34b281570f02 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b05700040f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710816.884649:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046c00/0xcbad34b281570f09 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710816.884665:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046c00/0xcbad34b281570f09 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710816.884676:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046c00/0xcbad34b281570f09 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710816.884690:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b281570f10 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710816.884697:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b281570f10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710816.884703:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b281570f10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710816.884789:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b281570f17 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710816.884798:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b281570f17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710816.884804:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b281570f17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790710816.884839:0:5846:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:2.0:1790710816.884843:0:5846:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790710816.884868:0:5846:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b281570f17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710816.884890:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b281570f17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710816.884898:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046c00/0xcbad34b281570f09 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710816.884905:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046c00/0xcbad34b281570f09 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710816.884913:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046c00/0xcbad34b281570f09 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710816.884918:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c8046c00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1790710816.884922:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046c00/0xcbad34b281570f09 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710816.884930:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046c00/0xcbad34b281570f09 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710816.884941:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9c51cca25200) 00010000:00010000:2.0:1790710816.884944:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790710816.884948:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046c00/0xcbad34b281570f09 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710816.884955:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046c00/0xcbad34b281570f09 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710816.884968:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b281570f10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710816.884973:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b281570f10 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710816.884984:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b281570f10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710816.884988:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c8046e00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1790710816.884990:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b281570f10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710816.884993:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b281570f10 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710816.884998:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xe219b27a (ffff9c51cca25000) 00010000:00010000:2.0:1790710816.885000:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790710816.885001:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b281570f10 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710816.885004:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b281570f10 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710816.885034:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047000/0xcbad34b281570f02 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700040f expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710816.885047:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b281570f17 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700040f expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710816.885054:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9c51c2c2ea00) 00010000:00010000:2.0:1790710816.885056:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790710816.885058:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c8047800, rc 0) 00000100:00100000:2.0:1790710816.885206:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+17:9667:x1877696158126208:12345-192.168.206.46@tcp:101:rm.0 Request processed in 663us (1012us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710816.885222:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 29 00000100:00100000:2.0:1790710816.888096:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710816.888203:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158126464 00000100:00100000:0.0:1790710816.888212:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158126464 00000100:00100000:0.0:1790710816.888443:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 30 00000100:00100000:0.0:1790710816.888453:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f3e76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+17:9667:x1877696158126464:12345-192.168.206.46@tcp:36:rm.0 00010000:00010000:0.0:1790710816.888510:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1790710816.888535:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b281570f17 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700040f expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.888556:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481400/0xcbad34b281570ec3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570003f3 expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.888585:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9c51c2c2ea00) 00010000:00010000:0.0:1790710816.888602:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030e00/0xcbad34b281570ed8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570003fa expref: 15 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.888612:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9c51cca25200) 00010000:00010000:0.0:1790710816.888615:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790710816.888634:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030200/0xcbad34b281570f1e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.888647:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030200/0xcbad34b281570f1e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.888655:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030200/0xcbad34b281570f1e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.888667:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281570f25 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.888673:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281570f25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.888679:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281570f25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.888778:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031600/0xcbad34b281570f2c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.888787:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031600/0xcbad34b281570f2c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.888805:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031600/0xcbad34b281570f2c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790710816.889950:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1790710816.889960:0:5845:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 294226832254ns, next at 295226830238ns, rc = 0 00010000:00010000:0.0:1790710816.890013:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031a00/0xcbad34b281570f33 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.890023:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031a00/0xcbad34b281570f33 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.890032:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031a00/0xcbad34b281570f33 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.890040:0:5845:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031a00/0xcbad34b281570f33 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.890046:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031a00/0xcbad34b281570f33 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.890051:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031a00/0xcbad34b281570f33 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.890111:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790710816.890160:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031600/0xcbad34b281570f2c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.890167:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031600/0xcbad34b281570f2c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.890173:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031600/0xcbad34b281570f2c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.890191:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c0031600 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1790710816.890196:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031600/0xcbad34b281570f2c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.890204:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031600/0xcbad34b281570f2c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.890216:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9c51e4efb600) 00010000:00010000:0.0:1790710816.890219:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1790710816.890223:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031600/0xcbad34b281570f2c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.890229:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031600/0xcbad34b281570f2c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.890254:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030200/0xcbad34b281570f1e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.890266:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030200/0xcbad34b281570f1e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.890277:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030200/0xcbad34b281570f1e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.890283:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c0030200 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1790710816.890286:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030200/0xcbad34b281570f1e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.890292:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030200/0xcbad34b281570f1e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.890310:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9c51cca25200) 00010000:00010000:0.0:1790710816.890312:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790710816.890315:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030200/0xcbad34b281570f1e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710816.890321:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030200/0xcbad34b281570f1e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790710816.890331:0:5845:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000005f121ae1 reply state 00000000f06bbf4d transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281570f25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710816.890338:0:5845:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790710816.890426:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f3e76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+16:9667:x1877696158126464:12345-192.168.206.46@tcp:36:rm.0 Request processed in 1973us (2341us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1790710816.890434:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 30 00010000:00010000:3.0:1790710816.891585:0:8509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790710816.891594:0:8509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031a00/0xcbad34b281570f33 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710816.891613:0:8509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c0031a00 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:3.0:1790710816.891617:0:8509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031a00/0xcbad34b281570f33 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710816.891624:0:8509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031a00/0xcbad34b281570f33 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710816.891634:0:8509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9c51e4efb600) 00010000:00010000:3.0:1790710816.891636:0:8509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1790710816.891640:0:8509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031a00/0xcbad34b281570f33 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710816.891644:0:8509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031a00/0xcbad34b281570f33 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710816.891725:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710816.891727:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710816.891729:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710816.893090:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281570f25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710816.893103:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281570f25 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710816.893111:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281570f25 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710816.893117:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c0030000 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1790710816.893121:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281570f25 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710816.893168:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281570f25 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710816.893180:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xe219b27a (ffff9c51e4efb100) 00010000:00010000:2.0:1790710816.893183:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790710816.893186:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281570f25 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710816.893192:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281570f25 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710816.899857:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710816.901185:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158126720 00000100:00100000:1.0:1790710816.901198:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158126720 00000100:00100000:1.0:1790710816.901256:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 5 00000100:00100000:1.0:1790710816.901265:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f3e74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+15:9667:x1877696158126720:12345-192.168.206.46@tcp:35:rm.0 00000100:00100000:1.0:1790710816.901512:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f3e74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+16:9667:x1877696158126720:12345-192.168.206.46@tcp:35:rm.0 Request processed in 248us (1669us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1790710816.901520:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 5 00000100:00100000:0.0:1790710816.905776:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710816.905930:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158126976 00000100:00100000:3.0:1790710816.905939:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158126976 00000100:00100000:3.0:1790710816.905994:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 31 00000100:00100000:3.0:1790710816.906002:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+16:9667:x1877696158126976:12345-192.168.206.46@tcp:36:rm.0 00010000:00010000:3.0:1790710816.906055:0:8060:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1790710816.906080:0:8060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281570ef4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000408 expref: 16 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710816.906102:0:8060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b281570e92 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570003e5 expref: 15 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710816.906113:0:8060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9c51cca25200) 00010000:00010000:3.0:1790710816.906282:0:8060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030c00/0xcbad34b281570e53 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570003d7 expref: 14 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710816.906317:0:8060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c51e4efba00) 00010000:00010000:3.0:1790710816.906332:0:8060:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790710816.906353:0:8060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b281570f3a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710816.906366:0:8060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b281570f3a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710816.906376:0:8060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b281570f3a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710816.906388:0:8060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645000/0xcbad34b281570f41 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710816.906395:0:8060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645000/0xcbad34b281570f41 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710816.906402:0:8060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645000/0xcbad34b281570f41 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710816.906644:0:8060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216b400/0xcbad34b281570f48 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710816.906652:0:8060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216b400/0xcbad34b281570f48 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710816.906659:0:8060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216b400/0xcbad34b281570f48 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790710816.907257:0:8060:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1790710816.907278:0:8060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216b400/0xcbad34b281570f48 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710816.907291:0:8060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216b400/0xcbad34b281570f48 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710816.907298:0:8060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216b400/0xcbad34b281570f48 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710816.907304:0:8060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c520216b400 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1790710816.907308:0:8060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216b400/0xcbad34b281570f48 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710816.907316:0:8060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216b400/0xcbad34b281570f48 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710816.907325:0:8060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9c51c2c2ec00) 00010000:00010000:3.0:1790710816.907328:0:8060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1790710816.907332:0:8060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216b400/0xcbad34b281570f48 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710816.907338:0:8060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216b400/0xcbad34b281570f48 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710816.907357:0:8060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b281570f3a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710816.907363:0:8060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b281570f3a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710816.907369:0:8060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b281570f3a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710816.907374:0:8060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c1645c00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1790710816.907383:0:8060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b281570f3a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710816.907389:0:8060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b281570f3a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710816.907397:0:8060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c51c2c2e800) 00010000:00010000:3.0:1790710816.907400:0:8060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790710816.907403:0:8060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b281570f3a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710816.907421:0:8060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b281570f3a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790710816.907434:0:8060:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000a2ac1c18 reply state 00000000eb943882 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645000/0xcbad34b281570f41 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710816.907442:0:8060:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790710816.907511:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+15:9667:x1877696158126976:12345-192.168.206.46@tcp:36:rm.0 Request processed in 1508us (1741us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1790710816.907519:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 31 00010000:00010000:3.0:1790710816.910170:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645000/0xcbad34b281570f41 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710816.910185:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645000/0xcbad34b281570f41 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710816.910193:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645000/0xcbad34b281570f41 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710816.910199:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c1645000 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1790710816.910203:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645000/0xcbad34b281570f41 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710816.910224:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645000/0xcbad34b281570f41 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710816.910239:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9c51c2c2e900) 00010000:00010000:3.0:1790710816.910242:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790710816.910247:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645000/0xcbad34b281570f41 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710816.910252:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645000/0xcbad34b281570f41 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710817.287779:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790710818.311461:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710819.339891:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790710819.594590:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f3e75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d27fc27-b651-404a-bd8c-b798806fb18a:3312:1877696177033088:0@lo:400:kworker.0 00000100:00100000:2.0:1790710819.594650:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710819.594691:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f3e77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1877696177033600:0@lo:400:kworker.0 00000100:00100000:2.0:1790710819.594716:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710819.594740:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790710819.594746:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f3e74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1877696177033472:0@lo:400:kworker.0 00000100:00100000:2.0:1790710819.594769:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710819.594795:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f3e74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877696177033216:0@lo:400:kworker.0 00000100:00100000:2.0:1790710819.594830:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710819.594850:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f3e74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1877696177033728:0@lo:400:kworker.0 00000100:00100000:2.0:1790710819.594872:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710819.594889:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790710819.594894:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f3e75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1877696177033344:0@lo:400:kworker.0 00000100:00100000:2.0:1790710819.594915:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710819.594954:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177033088 00000100:00100000:2.0:1790710819.594961:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177033088 00000100:00100000:2.0:1790710819.595001:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1790710819.595010:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c64efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+19:3312:x1877696177033088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790710819.595056:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c64efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+19:3312:x1877696177033088:12345-0@lo:400:kworker.0 Request processed in 47us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710819.595064:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1790710819.595097:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177033600 00000100:00100000:2.0:1790710819.595102:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177033600 00000100:00100000:2.0:1790710819.595147:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177033216 00000100:00100000:2.0:1790710819.595151:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177033216 00000100:00100000:2.0:1790710819.595167:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177033344 00000100:00100000:2.0:1790710819.595169:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177033344 00000100:00100000:2.0:1790710819.595190:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1790710819.595196:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f3e76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1877696177033600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790710819.595226:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f3e76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1877696177033600:12345-0@lo:400:kworker.0 Request processed in 30us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710819.595232:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1790710819.595244:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1790710819.595250:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4867800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877696177033216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790710819.595278:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4867800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877696177033216:12345-0@lo:400:kworker.0 Request processed in 29us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710819.595283:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1790710819.595293:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1790710819.595299:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4866a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877696177033344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790710819.595507:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4866a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877696177033344:12345-0@lo:400:kworker.0 Request processed in 207us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710819.595513:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1790710819.595533:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177033472 00000100:00100000:2.0:1790710819.595537:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177033472 00000100:00100000:2.0:1790710819.595564:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177033728 00000100:00100000:2.0:1790710819.595567:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177033728 00000100:00100000:2.0:1790710819.595582:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1790710819.595588:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f3e74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1877696177033472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790710819.595626:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f3e74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1877696177033472:12345-0@lo:400:kworker.0 Request processed in 38us (856us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710819.595632:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1790710819.595643:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1790710819.595648:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4866300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1877696177033728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790710819.595680:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4866300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1877696177033728:12345-0@lo:400:kworker.0 Request processed in 32us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710819.595686:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:2.0:1790710819.595709:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790710819.595713:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790710819.595716:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790710819.595747:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f3e75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1877696177033344:0@lo:400:kworker.0 00000100:00100000:2.0:1790710819.595757:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f3e74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877696177033216:0@lo:400:kworker.0 00010000:00080000:2.0:1790710819.595768:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51f3e74380 x1877696177033728/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790710835 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790710819.595778:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f3e74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1877696177033728:0@lo:400:kworker.0 00010000:00080000:2.0:1790710819.595808:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51f3e74e00 x1877696177033472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790710835 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790710819.595817:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f3e74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1877696177033472:0@lo:400:kworker.0 00000100:00100000:2.0:1790710819.595825:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f3e75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d27fc27-b651-404a-bd8c-b798806fb18a:3312:1877696177033088:0@lo:400:kworker.0 00000100:00100000:2.0:1790710819.595833:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f3e77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1877696177033600:0@lo:400:kworker.0 00000004:00080000:2.0:1790710820.104348:0:8059:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 297441218589ns, next at 298441216879ns, rc = 0 00000100:00100000:1.0:1790710820.104444:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4864000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1877696177033856:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790710820.104508:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710820.104556:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177033856 00000100:00100000:0.0:1790710820.104564:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177033856 00000100:00100000:0.0:1790710820.104623:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1790710820.104632:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9b06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877696177033856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790710820.104664:0:6699:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790710820.104711:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9b06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877696177033856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710820.104718:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:0.0:1790710820.104756:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51f4864000 x1877696177033856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790710836 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790710820.104773:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4864000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1877696177033856:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1790710820.362121:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790710820.616248:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9b04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177033984:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790710820.616314:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710820.616711:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177033984 00000100:00100000:1.0:1790710820.616719:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177033984 00000100:00100000:1.0:1790710820.616770:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1790710820.616780:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4865c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877696177033984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790710820.616814:0:6699:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790710820.616855:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4865c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877696177033984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710820.616870:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1790710820.617819:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51f9b04000 x1877696177033984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790710836 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790710820.617841:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9b04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177033984:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790710820.829471:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710820.829518:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710820.829901:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710820.829943:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710820.829986:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158127232 00000100:00100000:0.0:1790710820.829994:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158127232 00000100:00100000:0.0:1790710820.830036:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158127488 00000100:00100000:0.0:1790710820.830039:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158127488 00000100:00100000:0.0:1790710820.830058:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 102 00000100:00100000:0.0:1790710820.830077:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f8ce5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+14:2359:x1877696158127232:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:1.0:1790710820.830385:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 103 00000100:00100000:1.0:1790710820.830404:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f8ce4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1b59f23d-9a5c-439d-bd4a-453bf2315b97+5:2359:x1877696158127488:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:1.0:1790710820.830441:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f8ce4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1b59f23d-9a5c-439d-bd4a-453bf2315b97+5:2359:x1877696158127488:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 40us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710820.830448:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 103 00000100:00080000:1.0:1790710820.830555:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790710820.830716:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f8ce5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+14:2359:x1877696158127232:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 639us (813us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710820.830723:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 102 00000100:00100000:3.0:1790710820.833303:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158127104 00000100:00100000:3.0:1790710820.833314:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158127104 00000100:00100000:3.0:1790710820.833368:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 250 00000100:00100000:3.0:1790710820.833376:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c64ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b75d7a5-152f-4db9-bf19-5fe279a322e3+13:2359:x1877696158127104:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:3.0:1790710820.833452:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c64ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b75d7a5-152f-4db9-bf19-5fe279a322e3+13:2359:x1877696158127104:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 76us (3989us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710820.833459:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 250 00000100:00100000:2.0:1790710820.833770:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158127360 00000100:00100000:2.0:1790710820.833775:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158127360 00000100:00100000:2.0:1790710820.839297:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 55 00000100:00100000:2.0:1790710820.839314:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f8ce7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+5:2359:x1877696158127360:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:2.0:1790710820.839409:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f8ce7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+5:2359:x1877696158127360:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 100us (9888us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710820.839418:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 55 00000100:00080000:1.0:1790710820.841764:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1790710821.383520:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1790710821.689491:0:5867:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967306 is committed 00000004:00080000:1.0:1790710821.689502:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:1.0:1790710821.689525:0:5867:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000004:00080000:1.0:1790710821.689531:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:1.0:1790710821.689539:0:5867:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000100:00100000:0.0:1790710821.689772:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790710821.689855:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c75dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177034112:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1790710821.689923:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710821.693419:0:6696:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177034112 00000100:00100000:2.0:1790710821.693432:0:6696:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177034112 00000100:00100000:3.0:1790710821.693763:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790710821.693774:0:6696:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f8ce4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1877696177034112:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1790710821.693817:0:6696:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:3.0:1790710821.693848:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6abc1420, atime: 0x6abc1420, ctime: 0x6abc1420, blocks: 0x1 00010000:00010000:3.0:1790710821.693857:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c76ef3b7/0xcbad34b281570f4f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710821.693887:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=299s v=(0 0) 00010000:00010000:3.0:1790710821.693891:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790710821.693898:0:6696:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c76ef3b7/0xcbad34b281570f4f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710821.693914:0:6696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c76ef3b7/0xcbad34b281570f4f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710821.693924:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c76ef3b7/0xcbad34b281570f4f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710821.693933:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c76ef3b7/0xcbad34b281570f4f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710821.693951:0:6696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:2.0:1790710821.694335:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1790710821.694363:0:8509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790710821.694370:0:8509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c76ef3b7/0xcbad34b281570f4f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710821.694381:0:8509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c520216a800 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:2.0:1790710821.694397:0:8509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c76ef3b7/0xcbad34b281570f4f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710821.694408:0:8509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c76ef3b7/0xcbad34b281570f4f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710821.694427:0:8509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c76ef3b7/0xcbad34b281570f4f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710821.694436:0:8509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c76ef3b7/0xcbad34b281570f4f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710821.694646:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710821.694648:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710821.694650:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790710821.695714:0:6696:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f8ce4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3311:x1877696177034112:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1937us (5786us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1790710821.695724:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:0.0:1790710821.695985:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c51c75dd880/2, rc 0, transno 4294967300 00000100:00100000:0.0:1790710821.695993:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c75dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177034112:0@lo:6:osp-syn-1-0.0 00000001:00080000:3.0:1790710822.300565:0:7643:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:1.0:1790710822.410831:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790710822.673712:0:11610:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:1.0:1790710823.431369:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1790710824.213522:0:11658:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffc936e1a0 20000000:00000080:3.0:1790710824.213537:0:11658:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c51f4ec1000 uarg=0000000000000000 20000000:01000000:3.0:1790710824.213578:0:11658:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1790710824.213583:0:11658:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1790710824.213588:0:11658:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1790710824.214088:0:11659:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1790710824.214445:0:11658:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1790710824.218765:0:11658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1790710824.218827:0:11658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1790710824.218890:0:11658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1790710824.218906:0:11658:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1790710824.218923:0:11658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c520216b400/0xcbad34b281570f56 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710824.218941:0:11658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c51c8046800/0xcbad34b281570df8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281570df1 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710824.218950:0:11658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c51c6480800/0xcbad34b281570e06 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281570dff expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710824.218957:0:11658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c51c8046a00/0xcbad34b281570e14 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281570e0d expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710824.218966:0:11658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c51c0031800/0xcbad34b281570e1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570003c2 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710824.218974:0:11658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c51c1644a00/0xcbad34b281570e22 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570003c9 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710824.218981:0:11658:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c520216b400/0xcbad34b281570f56 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710824.219016:0:11658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c51c1644a00/0xcbad34b281570e22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.46@tcp remote: 0x566877b0570003c9 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710824.219031:0:11658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c51c1644a00/0xcbad34b281570e22 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570003c9 expref: 12 pid: 5838 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710824.219045:0:11658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c75dc380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11658:1877696177034240:192.168.206.46@tcp:104: 00010000:00010000:3.0:1790710824.220463:0:11658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c51c0031800/0xcbad34b281570e1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.46@tcp remote: 0x566877b0570003c2 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710824.220478:0:11658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c51c0031800/0xcbad34b281570e1b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570003c2 expref: 12 pid: 5838 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710824.220491:0:11658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c75ded80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11658:1877696177034368:192.168.206.46@tcp:104: 00010000:00010000:3.0:1790710824.220544:0:11658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c51c8046a00/0xcbad34b281570e14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbad34b281570e0d expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710824.220553:0:11658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c51c8046a00/0xcbad34b281570e14 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbad34b281570e0d expref: 18 pid: 5838 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710824.220563:0:11658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c75df480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11658:1877696177034496:0@lo:104: 00000100:00100000:3.0:1790710824.220596:0:11658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790710824.220637:0:11658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c51c6480800/0xcbad34b281570e06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbad34b281570dff expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710824.220646:0:11658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c51c6480800/0xcbad34b281570e06 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbad34b281570dff expref: 18 pid: 5838 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710824.220655:0:11658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c75de300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11658:1877696177034624:0@lo:104: 00000100:00100000:3.0:1790710824.220675:0:11658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790710824.220700:0:11658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c51c8046800/0xcbad34b281570df8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbad34b281570df1 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710824.220708:0:11658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c51c8046800/0xcbad34b281570df8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbad34b281570df1 expref: 18 pid: 5840 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710824.220717:0:11658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9574e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11658:1877696177034752:0@lo:104: 00000100:00100000:3.0:1790710824.220746:0:11658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710824.220756:0:11658:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f9f1c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790710824.220964:0:5827:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1790710824.220977:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177034496 00000100:00100000:0.0:1790710824.220983:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177034496 00000100:00100000:0.0:1790710824.221020:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177034624 00000100:00100000:0.0:1790710824.221023:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177034624 00000100:00100000:0.0:1790710824.221033:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177034752 00000100:00100000:0.0:1790710824.221036:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177034752 00000100:00100000:0.0:1790710824.221048:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790710824.221056:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c75de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5d27fc27-b651-404a-bd8c-b798806fb18a+5:11658:x1877696177034496:12345-0@lo:104: 00010000:00010000:0.0:1790710824.221076:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.146@tcp lock: ffff9c51c1645400/0xcbad34b281570e0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbad34b281570e14 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710824.221368:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790710824.221386:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c75de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5d27fc27-b651-404a-bd8c-b798806fb18a+5:11658:x1877696177034496:12345-0@lo:104: Request processed in 331us (790us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710824.221394:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790710824.221411:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790710824.221418:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c75dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5d27fc27-b651-404a-bd8c-b798806fb18a+4:11658:x1877696177034624:12345-0@lo:104: 00010000:00010000:0.0:1790710824.221425:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.146@tcp lock: ffff9c51c1645800/0xcbad34b281570dff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbad34b281570e06 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710824.221521:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1790710824.221527:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c75dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5d27fc27-b651-404a-bd8c-b798806fb18a+4:11658:x1877696177034624:12345-0@lo:104: Request processed in 111us (851us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710824.221533:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790710824.221545:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790710824.221551:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff9c0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5d27fc27-b651-404a-bd8c-b798806fb18a+3:11658:x1877696177034752:12345-0@lo:104: 00010000:00010000:0.0:1790710824.221558:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.146@tcp lock: ffff9c51c1645e00/0xcbad34b281570df1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbad34b281570df8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710824.221585:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1790710824.221590:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff9c0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5d27fc27-b651-404a-bd8c-b798806fb18a+3:11658:x1877696177034752:12345-0@lo:104: Request processed in 40us (843us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710824.221596:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:2.0:1790710824.221686:0:8509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1790710824.221692:0:8509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.146@tcp lock: ffff9c51c1645400/0xcbad34b281570e0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbad34b281570e14 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710824.221700:0:8509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c1645400 already unused, calling callback (ffffffffc1cdfc20) 10000000:00010000:2.0:1790710824.221705:0:8509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.146@tcp lock: ffff9c51c1645400/0xcbad34b281570e0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbad34b281570e14 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710824.221713:0:8509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.146@tcp lock: ffff9c51c1645400/0xcbad34b281570e0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbad34b281570e14 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790710824.221721:0:8509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.146@tcp lock: ffff9c51c1645400/0xcbad34b281570e0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbad34b281570e14 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790710824.221726:0:8509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790710824.221753:0:8509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.146@tcp lock: ffff9c51c1645400/0xcbad34b281570e0d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281570e14 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710824.221759:0:8509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790710824.221774:0:8509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.146@tcp lock: ffff9c51c1645400/0xcbad34b281570e0d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281570e14 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710824.221781:0:8509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.146@tcp lock: ffff9c51c1645400/0xcbad34b281570e0d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281570e14 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710824.221793:0:8509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790710824.221803:0:8509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.146@tcp lock: ffff9c51c1645800/0xcbad34b281570dff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbad34b281570e06 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710824.221809:0:8509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c1645800 already unused, calling callback (ffffffffc1cdfc20) 10000000:00010000:2.0:1790710824.221812:0:8509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.146@tcp lock: ffff9c51c1645800/0xcbad34b281570dff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbad34b281570e06 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710824.221819:0:8509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.146@tcp lock: ffff9c51c1645800/0xcbad34b281570dff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbad34b281570e06 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790710824.221825:0:8509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.146@tcp lock: ffff9c51c1645800/0xcbad34b281570dff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbad34b281570e06 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790710824.221831:0:8509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790710824.221844:0:8509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.146@tcp lock: ffff9c51c1645800/0xcbad34b281570dff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281570e06 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710824.221850:0:8509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790710824.221856:0:8509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.146@tcp lock: ffff9c51c1645800/0xcbad34b281570dff lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281570e06 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710824.221863:0:8509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.146@tcp lock: ffff9c51c1645800/0xcbad34b281570dff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281570e06 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710824.221871:0:8509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790710824.221874:0:8509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.146@tcp lock: ffff9c51c1645e00/0xcbad34b281570df1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbad34b281570df8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710824.221880:0:8509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c1645e00 already unused, calling callback (ffffffffc1cdfc20) 10000000:00010000:2.0:1790710824.221883:0:8509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.146@tcp lock: ffff9c51c1645e00/0xcbad34b281570df1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbad34b281570df8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710824.221899:0:8509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.146@tcp lock: ffff9c51c1645e00/0xcbad34b281570df1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbad34b281570df8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790710824.221906:0:8509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.146@tcp lock: ffff9c51c1645e00/0xcbad34b281570df1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbad34b281570df8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790710824.221911:0:8509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790710824.221922:0:8509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.146@tcp lock: ffff9c51c1645e00/0xcbad34b281570df1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281570df8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710824.221927:0:8509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790710824.221940:0:8509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.146@tcp lock: ffff9c51c1645e00/0xcbad34b281570df1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281570df8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710824.221946:0:8509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.146@tcp lock: ffff9c51c1645e00/0xcbad34b281570df1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281570df8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710824.221959:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710824.221961:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710824.221962:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790710824.221969:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790710824.221978:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4864e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d27fc27-b651-404a-bd8c-b798806fb18a:3312:1877696177035136:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790710824.222007:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710824.222062:0:11658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c75df480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11658:1877696177034496:0@lo:104: 00000100:00100000:2.0:1790710824.222070:0:11658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c75de300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11658:1877696177034624:0@lo:104: 00000100:00100000:2.0:1790710824.222076:0:11658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9574e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11658:1877696177034752:0@lo:104: 00010000:00010000:1.0:1790710824.222343:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790710824.222349:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790710824.222358:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177035136 00000100:00100000:1.0:1790710824.222363:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177035136 00010000:00010000:1.0:1790710824.222396:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c51c8046800/0xcbad34b281570df8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbad34b281570df1 expref: 19 pid: 5840 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710824.222421:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790710824.222427:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4867b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d27fc27-b651-404a-bd8c-b798806fb18a+19:3312:x1877696177035136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790710824.222506:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790710824.222517:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c51c8046800/0xcbad34b281570df8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbad34b281570df1 expref: 19 pid: 5840 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710824.222527:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c51c8046800/0xcbad34b281570df8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbad34b281570df1 expref: 19 pid: 5840 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710824.222540:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c51c8046800/0xcbad34b281570df8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbad34b281570df1 expref: 19 pid: 5840 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710824.222554:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790710824.222586:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4867b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d27fc27-b651-404a-bd8c-b798806fb18a+18:3312:x1877696177035136:12345-0@lo:103:ldlm_bl.0 Request processed in 160us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710824.222593:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790710824.222617:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4864e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d27fc27-b651-404a-bd8c-b798806fb18a:3312:1877696177035136:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790710824.222727:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4864700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d27fc27-b651-404a-bd8c-b798806fb18a:3309:1877696177034880:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790710824.222753:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710824.222793:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790710824.222799:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4865f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d27fc27-b651-404a-bd8c-b798806fb18a:3309:1877696177035008:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790710824.222821:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710824.222888:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177034880 00000100:00100000:2.0:1790710824.222893:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177034880 00010000:00010000:2.0:1790710824.222915:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c51c8046a00/0xcbad34b281570e14 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbad34b281570e0d expref: 18 pid: 5838 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710824.222938:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177035008 00000100:00100000:2.0:1790710824.222942:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177035008 00010000:00010000:2.0:1790710824.222953:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c51c6480800/0xcbad34b281570e06 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbad34b281570dff expref: 19 pid: 5838 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710824.222971:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790710824.222977:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f8ce6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d27fc27-b651-404a-bd8c-b798806fb18a+19:3309:x1877696177034880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790710824.222985:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790710824.222989:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c51c8046a00/0xcbad34b281570e14 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbad34b281570e0d expref: 19 pid: 5838 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710824.222997:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c51c8046a00/0xcbad34b281570e14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbad34b281570e0d expref: 19 pid: 5838 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710824.223007:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c51c8046a00/0xcbad34b281570e14 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbad34b281570e0d expref: 19 pid: 5838 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710824.223016:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790710824.223041:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f8ce6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d27fc27-b651-404a-bd8c-b798806fb18a+18:3309:x1877696177034880:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710824.223048:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790710824.223063:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790710824.223069:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c7cde850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d27fc27-b651-404a-bd8c-b798806fb18a+17:3309:x1877696177035008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790710824.223076:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790710824.223080:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c51c6480800/0xcbad34b281570e06 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbad34b281570dff expref: 17 pid: 5838 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710824.223100:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c51c6480800/0xcbad34b281570e06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbad34b281570dff expref: 17 pid: 5838 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710824.223109:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c51c6480800/0xcbad34b281570e06 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbad34b281570dff expref: 17 pid: 5838 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710824.223118:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790710824.223163:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c7cde850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d27fc27-b651-404a-bd8c-b798806fb18a+16:3309:x1877696177035008:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710824.223169:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790710824.223531:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4865f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d27fc27-b651-404a-bd8c-b798806fb18a:3309:1877696177035008:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790710824.223540:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4864700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d27fc27-b651-404a-bd8c-b798806fb18a:3309:1877696177034880:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790710824.226068:0:11658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c75dc380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11658:1877696177034240:192.168.206.46@tcp:104: 00000100:00100000:2.0:1790710824.226082:0:11658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c75ded80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11658:1877696177034368:192.168.206.46@tcp:104: 00010000:00010000:2.0:1790710824.226115:0:11658:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c520216b400/0xcbad34b281570f56 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710824.228070:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710824.228103:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710824.228740:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158127744 00000100:00100000:2.0:1790710824.228749:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158127744 00010000:00010000:2.0:1790710824.228796:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c51c0031800/0xcbad34b281570e1b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570003c2 expref: 13 pid: 5838 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710824.228824:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158127616 00000100:00100000:2.0:1790710824.228828:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158127616 00010000:00010000:2.0:1790710824.228840:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c51c1644a00/0xcbad34b281570e22 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570003c9 expref: 14 pid: 5838 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710824.228868:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 33 00000100:00100000:2.0:1790710824.228876:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f8ce4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b75d7a5-152f-4db9-bf19-5fe279a322e3+14:2358:x1877696158127744:12345-192.168.206.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790710824.228891:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790710824.228907:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c51c0031800/0xcbad34b281570e1b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570003c2 expref: 14 pid: 5838 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710824.228918:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c51c0031800/0xcbad34b281570e1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570003c2 expref: 14 pid: 5838 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710824.228936:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c51c0031800/0xcbad34b281570e1b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570003c2 expref: 14 pid: 5838 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710824.228951:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790710824.230531:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f8ce4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b75d7a5-152f-4db9-bf19-5fe279a322e3+13:2358:x1877696158127744:12345-192.168.206.46@tcp:103:ldlm_bl.0 Request processed in 1647us (2459us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710824.230544:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 33 00000100:00100000:2.0:1790710824.230576:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 34 00000100:00100000:2.0:1790710824.230587:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f8ce7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b75d7a5-152f-4db9-bf19-5fe279a322e3+12:2358:x1877696158127616:12345-192.168.206.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790710824.230600:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790710824.230608:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c51c1644a00/0xcbad34b281570e22 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570003c9 expref: 12 pid: 5838 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710824.230621:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c51c1644a00/0xcbad34b281570e22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570003c9 expref: 12 pid: 5838 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710824.230636:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c51c1644a00/0xcbad34b281570e22 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570003c9 expref: 12 pid: 5838 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710824.230651:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c520216b400/0xcbad34b281570f56 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710824.230660:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c520216b400/0xcbad34b281570f56 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710824.230684:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c520216b400/0xcbad34b281570f56 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710824.230690:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c520216b400/0xcbad34b281570f56 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710824.230697:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c520216b400/0xcbad34b281570f56 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710824.230704:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c520216b400/0xcbad34b281570f56 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710824.230709:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c520216b400 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:2.0:1790710824.230714:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c520216b400/0xcbad34b281570f56 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710824.230722:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c520216b400/0xcbad34b281570f56 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710824.230737:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c520216b400/0xcbad34b281570f56 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710824.230746:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790710824.230780:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f8ce7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b75d7a5-152f-4db9-bf19-5fe279a322e3+11:2358:x1877696158127616:12345-192.168.206.46@tcp:103:ldlm_bl.0 Request processed in 197us (2676us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710824.230787:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 34 00010000:00010000:2.0:1790710824.230905:0:11658:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c520216b400/0xcbad34b281570f56 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710824.230914:0:11658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c520216b400/0xcbad34b281570f56 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710824.230925:0:11658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c520216b400/0xcbad34b281570f56 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710824.455426:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790710824.711884:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9575500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877696177035392:0@lo:400:kworker.0 00000100:00100000:0.0:1790710824.711890:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51d032ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177035648:0@lo:400:kworker.0 00000100:00100000:1.0:1790710824.712499:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9577b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d27fc27-b651-404a-bd8c-b798806fb18a:3312:1877696177035264:0@lo:400:kworker.0 00000100:00100000:0.0:1790710824.712611:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710824.712682:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9574e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1877696177035520:0@lo:400:kworker.0 00000100:00100000:0.0:1790710824.712711:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710824.712757:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177035520 00000100:00100000:0.0:1790710824.712764:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177035520 00000100:00100000:0.0:1790710824.712816:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1790710824.712829:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c75ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1877696177035520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790710824.712882:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c75ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1877696177035520:12345-0@lo:400:kworker.0 Request processed in 57us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710824.712888:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1790710824.712929:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9574e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1877696177035520:0@lo:400:kworker.0 00000100:00100000:3.0:1790710824.714020:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177035648 00000100:00100000:3.0:1790710824.714030:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177035648 00000100:00100000:3.0:1790710824.714076:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1790710824.714085:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f8ce6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1877696177035648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790710824.714253:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f8ce6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1877696177035648:12345-0@lo:400:kworker.0 Request processed in 169us (1643us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710824.714261:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:3.0:1790710824.714296:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790710824.714301:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1790710824.714538:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51d032ed80 x1877696177035648/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790710840 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790710824.714551:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51d032ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177035648:0@lo:400:kworker.0 00000100:00100000:2.0:1790710824.720458:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710824.720458:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710824.720529:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51d032df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1877696177035904:0@lo:400:kworker.0 00000100:00100000:2.0:1790710824.720572:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710824.720617:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177035264 00000100:00100000:3.0:1790710824.720625:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177035264 00000100:00100000:2.0:1790710824.720638:0:6696:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177035904 00000100:00100000:2.0:1790710824.720645:0:6696:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177035904 00000100:00100000:3.0:1790710824.720678:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1790710824.720688:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c64ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+16:3312:x1877696177035264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790710824.720694:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1790710824.720704:0:6696:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4865500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1877696177035904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790710824.720745:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c64ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+16:3312:x1877696177035264:12345-0@lo:400:kworker.0 Request processed in 58us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710824.720755:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1790710824.720756:0:6696:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4865500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1877696177035904:12345-0@lo:400:kworker.0 Request processed in 51us (180us total) trans 0 rc 0/0 00000100:00080000:3.0:1790710824.720797:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790710824.720832:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:3.0:1790710824.720838:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c51c75dd880, transno 4294967300 00000100:00100000:3.0:1790710824.720849:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51d032df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1877696177035904:0@lo:400:kworker.0 00000100:00100000:0.0:1790710824.721190:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177035392 00000100:00100000:0.0:1790710824.721195:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177035392 00000100:00100000:0.0:1790710824.721250:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1790710824.721259:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4867b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877696177035392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790710824.721265:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9577b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d27fc27-b651-404a-bd8c-b798806fb18a:3312:1877696177035264:0@lo:400:kworker.0 00000100:00100000:1.0:1790710824.721275:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51d032ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1877696177035776:0@lo:400:kworker.0 00000100:00100000:1.0:1790710824.721314:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710824.721315:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4867b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877696177035392:12345-0@lo:400:kworker.0 Request processed in 54us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710824.721324:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1790710824.721340:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177035776 00000100:00100000:0.0:1790710824.721344:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177035776 00000100:00100000:0.0:1790710824.721384:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1790710824.721391:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9b04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1877696177035776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790710824.721420:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9b04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1877696177035776:12345-0@lo:400:kworker.0 Request processed in 30us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710824.721425:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:0.0:1790710824.721446:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790710824.721478:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9575500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877696177035392:0@lo:400:kworker.0 00000100:00100000:1.0:1790710824.721500:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51d032ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1877696177035776:0@lo:400:kworker.0 00000100:00100000:2.0:1790710824.723729:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1790710825.224006:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4864a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1877696177036032:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790710825.224075:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710825.224484:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177036032 00000100:00100000:1.0:1790710825.224492:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177036032 00000100:00100000:1.0:1790710825.224548:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1790710825.224558:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c75dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877696177036032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790710825.224596:0:6699:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790710825.226810:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c75dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877696177036032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2243us (2723us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710825.226841:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1790710825.226964:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4864a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1877696177036032:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1790710825.479438:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790710825.749885:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9b07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177036160:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790710825.749952:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710825.750164:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177036160 00000100:00100000:1.0:1790710825.750174:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177036160 00000100:00100000:1.0:1790710825.750237:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1790710825.750248:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c75de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877696177036160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790710825.750283:0:6700:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790710825.750332:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c75de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877696177036160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710825.750340:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1790710825.750518:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51f9b07b80 x1877696177036160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790710841 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790710825.750537:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9b07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177036160:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790710825.953792:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710825.953855:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710825.953892:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710825.953921:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710825.954013:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158128000 00000100:00100000:0.0:1790710825.954026:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158128000 00000100:00100000:0.0:1790710825.954103:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158128256 00000100:00100000:0.0:1790710825.954106:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158128256 00000100:00100000:0.0:1790710825.954169:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 107 00000100:00100000:0.0:1790710825.954181:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9b05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+5:2358:x1877696158128000:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:0.0:1790710825.954301:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9b05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+5:2358:x1877696158128000:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 122us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710825.954327:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 107 00000100:00100000:2.0:1790710825.954358:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158127872 00000100:00100000:0.0:1790710825.954358:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 108 00000100:00100000:0.0:1790710825.954385:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9b04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1b59f23d-9a5c-439d-bd4a-453bf2315b97+5:2358:x1877696158128256:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:2.0:1790710825.954386:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158127872 00000100:00100000:0.0:1790710825.954423:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9b04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1b59f23d-9a5c-439d-bd4a-453bf2315b97+5:2358:x1877696158128256:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 43us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710825.954431:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 108 00000100:00100000:2.0:1790710825.954469:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 252 00000100:00100000:2.0:1790710825.954486:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c64ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b75d7a5-152f-4db9-bf19-5fe279a322e3+11:2359:x1877696158127872:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:2.0:1790710825.954556:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c64ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b75d7a5-152f-4db9-bf19-5fe279a322e3+11:2359:x1877696158127872:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 77us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710825.954566:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 252 00000100:00100000:0.0:1790710825.954609:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158128128 00000100:00100000:0.0:1790710825.954615:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158128128 00000100:00100000:0.0:1790710825.954663:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 58 00000100:00100000:0.0:1790710825.954673:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9b04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+5:2359:x1877696158128128:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:0.0:1790710825.954732:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9b04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+5:2359:x1877696158128128:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 62us (839us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710825.954740:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 58 00000100:00080000:1.0:1790710825.955074:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790710825.955081:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 10000000:01000000:0.0:1790710826.055225:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790710826.055237:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c51ff4b3000 from 7 10000000:01000000:0.0:1790710826.055244:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790710826.055309:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c0030e00/0xcbad34b281570f5d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710826.055324:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.146@tcp lock: ffff9c51c0030e00/0xcbad34b281570f5d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710826.055338:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.146@tcp lock: ffff9c51c0030e00/0xcbad34b281570f5d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710826.055387:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c75df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177036288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790710826.055506:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710826.055593:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c679c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790710826.056085:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177036288 00000100:00100000:3.0:1790710826.056104:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177036288 00000100:00100000:3.0:1790710826.056200:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1790710826.056211:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c64ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+16:5842:x1877696177036288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790710826.056239:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790710826.056259:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c520216ba00/0xcbad34b281570f64 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbad34b281570f5d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710826.056288:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c520216ba00/0xcbad34b281570f64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbad34b281570f5d expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710826.056299:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c520216ba00/0xcbad34b281570f64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281570f5d expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710826.056307:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c520216ba00, rc 0) 00000100:00100000:3.0:1790710826.056381:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c64ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+17:5842:x1877696177036288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 172us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710826.056388:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1790710826.056652:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c75df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177036288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790710826.056672:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.146@tcp lock: ffff9c51c0030e00/0xcbad34b281570f5d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570f64 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710826.056681:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.146@tcp lock: ffff9c51c0030e00/0xcbad34b281570f5d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbad34b281570f64 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710826.056755:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c75df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177036416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790710826.056791:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710826.056825:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c679c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790710826.057094:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177036416 00000100:00100000:2.0:1790710826.057109:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177036416 00000100:00100000:2.0:1790710826.058122:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1790710826.058150:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c64ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+17:5842:x1877696177036416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790710826.058489:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c64ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+17:5842:x1877696177036416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 339us (1695us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710826.058497:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1790710826.058596:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c75df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177036416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790710826.058647:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51d032df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177036544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790710826.058695:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710826.069657:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f9f1c300 going to sleep for 11 seconds 00000100:00100000:0.0:1790710826.071554:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177036544 00000100:00100000:0.0:1790710826.071568:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177036544 00000100:00100000:0.0:1790710826.071628:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1790710826.071638:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c64ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+17:5842:x1877696177036544:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790710826.076333:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c64ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+17:5842:x1877696177036544:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 4687us (17628us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710826.076348:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1790710826.076573:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51d032df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177036544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790710826.078734:0:11671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51d032df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d27fc27-b651-404a-bd8c-b798806fb18a:11671:1877696177036672:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790710826.078815:0:11671:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710826.078875:0:11671:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f9f1c900 going to sleep for 11 seconds 00000100:00100000:0.0:1790710826.078959:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177036672 00000100:00100000:0.0:1790710826.078966:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177036672 00000100:00100000:0.0:1790710826.079015:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1790710826.079025:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c64e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+17:11671:x1877696177036672:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790710826.079460:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c64e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+17:11671:x1877696177036672:12345-0@lo:502:llog_process_th.0 Request processed in 436us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710826.079469:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1790710826.079564:0:11671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51d032df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d27fc27-b651-404a-bd8c-b798806fb18a:11671:1877696177036672:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790710826.079601:0:11671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790710826.079612:0:11671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790710826.079614:0:11671:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1790710826.079620:0:11671:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c51ff4b3000 00000020:00000080:3.0:1790710826.079623:0:11671:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1790710826.079704:0:11671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51d032df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d27fc27-b651-404a-bd8c-b798806fb18a:11671:1877696177036800:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790710826.079739:0:11671:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710826.079772:0:11671:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f9f1c900 going to sleep for 11 seconds 00000100:00100000:2.0:1790710826.079885:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710826.079946:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177036800 00000100:00100000:3.0:1790710826.079952:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177036800 00000100:00100000:3.0:1790710826.079984:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158128384 00000100:00100000:3.0:1790710826.079987:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158128384 00000100:00100000:3.0:1790710826.080001:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1790710826.080007:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c64e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+17:11671:x1877696177036800:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790710826.080183:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c64e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+17:11671:x1877696177036800:12345-0@lo:502:llog_process_th.0 Request processed in 175us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710826.080190:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1790710826.080232:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 258 00000100:00100000:3.0:1790710826.080239:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c64e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b75d7a5-152f-4db9-bf19-5fe279a322e3+11:5596:x1877696158128384:12345-192.168.206.46@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790710826.080249:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790710826.080265:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c520216b000/0xcbad34b281570f6b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x566877b057000416 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710826.080289:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c520216b000/0xcbad34b281570f6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000416 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710826.080300:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c520216b000/0xcbad34b281570f6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000416 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710826.080321:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c520216b000, rc 0) 00000100:00100000:3.0:1790710826.080357:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c64e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b75d7a5-152f-4db9-bf19-5fe279a322e3+12:5596:x1877696158128384:12345-192.168.206.46@tcp:101:ll_cfg_requeue.0 Request processed in 118us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710826.080376:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 258 00000100:00100000:3.0:1790710826.080408:0:11671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51d032df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d27fc27-b651-404a-bd8c-b798806fb18a:11671:1877696177036800:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790710826.080431:0:11671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790710826.080436:0:11671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790710826.080437:0:11671:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1790710826.080441:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1790710826.081572:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1790710826.081609:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790710826.081619:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c0030e00/0xcbad34b281570f5d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570f64 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710826.081629:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.146@tcp lock: ffff9c51c0030e00/0xcbad34b281570f5d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570f64 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790710826.081638:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790710826.081641:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c51f444d000 from 7 10000000:01000000:2.0:1790710826.081644:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790710826.081672:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c8046c00/0xcbad34b281570f72 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710826.081679:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.146@tcp lock: ffff9c51c8046c00/0xcbad34b281570f72 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710826.081688:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.146@tcp lock: ffff9c51c8046c00/0xcbad34b281570f72 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710826.081706:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4867100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177036928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790710826.081752:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710826.081784:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51ff9fa600 going to sleep for 11 seconds 00000100:00100000:3.0:1790710826.083454:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177036928 00000100:00100000:3.0:1790710826.083464:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177036928 00000100:00100000:3.0:1790710826.083512:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1790710826.083521:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c64e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+17:5842:x1877696177036928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790710826.083536:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790710826.083552:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c520216a000/0xcbad34b281570f79 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbad34b281570f72 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710826.083576:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c520216a000/0xcbad34b281570f79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbad34b281570f72 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710826.083586:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c520216a000/0xcbad34b281570f79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281570f72 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710826.083595:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c520216a000, rc 0) 00000100:00100000:3.0:1790710826.083657:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c64e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+18:5842:x1877696177036928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (1904us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710826.083675:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1790710826.083725:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4867100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177036928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790710826.083741:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.146@tcp lock: ffff9c51c8046c00/0xcbad34b281570f72 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570f79 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710826.083749:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.146@tcp lock: ffff9c51c8046c00/0xcbad34b281570f72 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbad34b281570f79 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710826.083810:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51d032df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177037056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790710826.085599:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710826.085637:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f9f1cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1790710826.085661:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177037056 00000100:00100000:3.0:1790710826.085667:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177037056 00000100:00100000:3.0:1790710826.085709:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1790710826.085717:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c64e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+18:5842:x1877696177037056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790710826.087762:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c64e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+18:5842:x1877696177037056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2040us (2162us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710826.087774:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1790710826.088167:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51d032df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177037056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790710826.088230:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9b05180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177037184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790710826.088290:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710826.088330:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51e4d50240 going to sleep for 11 seconds 00000100:00100000:1.0:1790710826.088347:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177037184 00000100:00100000:1.0:1790710826.088353:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177037184 00000100:00100000:1.0:1790710826.088686:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1790710826.088695:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c64e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+18:5842:x1877696177037184:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790710826.088876:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c64e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+18:5842:x1877696177037184:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 181us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710826.088904:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1790710826.088955:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9b05180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177037184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790710826.089169:0:11672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9b05180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d27fc27-b651-404a-bd8c-b798806fb18a:11672:1877696177037312:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790710826.089202:0:11672:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710826.089213:0:11672:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51e4d500c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790710826.090033:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710826.090058:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177037312 00000100:00100000:2.0:1790710826.090071:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177037312 00000100:00100000:2.0:1790710826.090096:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158128512 00000100:00100000:2.0:1790710826.090098:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158128512 00000100:00100000:2.0:1790710826.090110:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1790710826.090146:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c64e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+18:11672:x1877696177037312:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790710826.090767:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 263 00000100:00100000:3.0:1790710826.090779:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c80fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b75d7a5-152f-4db9-bf19-5fe279a322e3+12:5596:x1877696158128512:12345-192.168.206.46@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790710826.090955:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c64e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+18:11672:x1877696177037312:12345-0@lo:502:llog_process_th.0 Request processed in 827us (1740us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710826.090963:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1790710826.094594:0:11672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9b05180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d27fc27-b651-404a-bd8c-b798806fb18a:11672:1877696177037312:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790710826.094639:0:11672:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000100:00100000:3.0:1790710826.094922:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c80fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b75d7a5-152f-4db9-bf19-5fe279a322e3+12:5596:x1877696158128512:12345-192.168.206.46@tcp:501:ll_cfg_requeue.0 Request processed in 4143us (4890us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710826.094933:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 263 00000020:00000080:1.0:1790710826.098069:0:11672:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790710826.098077:0:11672:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1790710826.098093:0:11672:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c51f444d000 00000020:00000080:1.0:1790710826.098095:0:11672:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1790710826.098209:0:11672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9b05180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d27fc27-b651-404a-bd8c-b798806fb18a:11672:1877696177037440:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790710826.098288:0:11672:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710826.098335:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177037440 00000100:00100000:1.0:1790710826.098342:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177037440 00000100:00100000:1.0:1790710826.098397:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1790710826.098405:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c80fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+18:11672:x1877696177037440:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790710826.098607:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c80fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+18:11672:x1877696177037440:12345-0@lo:502:llog_process_th.0 Request processed in 202us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710826.098615:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1790710826.098668:0:11672:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51e4d500c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790710826.098690:0:11672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9b05180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d27fc27-b651-404a-bd8c-b798806fb18a:11672:1877696177037440:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790710826.098713:0:11672:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790710826.098718:0:11672:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790710826.098724:0:11672:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1790710826.098728:0:11672:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1790710826.098781:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1790710826.098801:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790710826.098811:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c8046c00/0xcbad34b281570f72 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570f79 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710826.098821:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.146@tcp lock: ffff9c51c8046c00/0xcbad34b281570f72 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570f79 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790710826.098830:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790710826.098832:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c51c67ea000 from 7 10000000:01000000:1.0:1790710826.098835:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790710826.098857:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c6481800/0xcbad34b281570f80 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710826.098865:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.146@tcp lock: ffff9c51c6481800/0xcbad34b281570f80 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710826.098874:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.146@tcp lock: ffff9c51c6481800/0xcbad34b281570f80 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710826.098887:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9b05180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177037568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790710826.098915:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710826.098929:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51e4d500c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790710826.098941:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177037568 00000100:00100000:1.0:1790710826.098957:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177037568 00000100:00100000:1.0:1790710826.098980:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1790710826.098986:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c80fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+18:5842:x1877696177037568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790710826.098993:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790710826.099010:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c51c6480800/0xcbad34b281570f87 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbad34b281570f80 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710826.099031:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c51c6480800/0xcbad34b281570f87 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbad34b281570f80 expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710826.099040:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c51c6480800/0xcbad34b281570f87 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281570f80 expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710826.099048:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c6480800, rc 0) 00000100:00100000:1.0:1790710826.099076:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c80fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+19:5842:x1877696177037568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 90us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710826.099082:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1790710826.099110:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9b05180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177037568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790710826.099121:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.146@tcp lock: ffff9c51c6481800/0xcbad34b281570f80 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570f87 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710826.099151:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.146@tcp lock: ffff9c51c6481800/0xcbad34b281570f80 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbad34b281570f87 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710826.099189:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9b05180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177037696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790710826.099212:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710826.099225:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51e4d500c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790710826.099236:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177037696 00000100:00100000:1.0:1790710826.099239:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177037696 00000100:00100000:1.0:1790710826.099255:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1790710826.099260:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c80fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+19:5842:x1877696177037696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790710826.099474:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c80fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+19:5842:x1877696177037696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 212us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710826.099486:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1790710826.099515:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9b05180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177037696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790710826.099540:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9b05180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177037824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790710826.107915:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710826.107979:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51e4d500c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790710826.108095:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177037824 00000100:00100000:0.0:1790710826.108105:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177037824 00000100:00100000:0.0:1790710826.108183:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1790710826.108193:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c80f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+19:5842:x1877696177037824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790710826.108428:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c80f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+19:5842:x1877696177037824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 235us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710826.108435:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1790710826.111695:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9b05180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d27fc27-b651-404a-bd8c-b798806fb18a:5842:1877696177037824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790710826.112221:0:11674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9b05180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d27fc27-b651-404a-bd8c-b798806fb18a:11674:1877696177037952:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790710826.112299:0:11674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710826.112345:0:11674:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51e4d50a80 going to sleep for 11 seconds 00000100:00100000:0.0:1790710826.112530:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177037952 00000100:00100000:0.0:1790710826.112537:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177037952 00000100:00100000:0.0:1790710826.112586:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1790710826.112596:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c80f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+19:11674:x1877696177037952:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790710826.112821:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c80f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+19:11674:x1877696177037952:12345-0@lo:502:llog_process_th.0 Request processed in 226us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710826.112829:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1790710826.113497:0:11674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9b05180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d27fc27-b651-404a-bd8c-b798806fb18a:11674:1877696177037952:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790710826.113528:0:11674:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790710826.113539:0:11674:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790710826.113542:0:11674:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1790710826.113549:0:11674:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c51c67ea000 00000020:00000080:1.0:1790710826.113551:0:11674:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1790710826.113637:0:11674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9b05180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d27fc27-b651-404a-bd8c-b798806fb18a:11674:1877696177038080:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790710826.113695:0:11674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710826.113722:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177038080 00000100:00100000:1.0:1790710826.113728:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177038080 00000100:00100000:1.0:1790710826.113755:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1790710826.113762:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c80fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+19:11674:x1877696177038080:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790710826.113920:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c80fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+19:11674:x1877696177038080:12345-0@lo:502:llog_process_th.0 Request processed in 158us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710826.113928:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1790710826.113988:0:11674:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51e4d50a80 going to sleep for 11 seconds 00000100:00100000:1.0:1790710826.114000:0:11674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9b05180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d27fc27-b651-404a-bd8c-b798806fb18a:11674:1877696177038080:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790710826.114017:0:11674:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790710826.114021:0:11674:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790710826.114023:0:11674:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1790710826.114026:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000100:00100000:2.0:1790710826.114603:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000020:01000000:0.0:1790710826.115037:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1790710826.115058:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790710826.115068:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c6481800/0xcbad34b281570f80 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570f87 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710826.115079:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.146@tcp lock: ffff9c51c6481800/0xcbad34b281570f80 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570f87 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710826.115101:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158128640 00000100:00100000:0.0:1790710826.115106:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158128640 00000100:00100000:0.0:1790710826.115179:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 270 00000100:00100000:0.0:1790710826.115187:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c80f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b75d7a5-152f-4db9-bf19-5fe279a322e3+12:5596:x1877696158128640:12345-192.168.206.46@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790710826.115395:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c80f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b75d7a5-152f-4db9-bf19-5fe279a322e3+12:5596:x1877696158128640:12345-192.168.206.46@tcp:503:ll_cfg_requeue.0 Request processed in 208us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710826.115408:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 270 00000100:00100000:3.0:1790710826.128600:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710826.129460:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158128768 00000100:00100000:0.0:1790710826.129472:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158128768 00000100:00100000:0.0:1790710826.129540:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 271 00000100:00100000:0.0:1790710826.129550:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c80f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b75d7a5-152f-4db9-bf19-5fe279a322e3+12:9938:x1877696158128768:12345-192.168.206.46@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790710826.129869:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c80f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b75d7a5-152f-4db9-bf19-5fe279a322e3+12:9938:x1877696158128768:12345-192.168.206.46@tcp:502:llog_process_th.0 Request processed in 245us (1202us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710826.129900:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 271 00000040:00080000:2.0:1790710826.141394:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1790710826.141994:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710826.142103:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158128896 00000100:00100000:3.0:1790710826.142124:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158128896 00000100:00100000:3.0:1790710826.142190:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 272 00000100:00100000:3.0:1790710826.142199:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c80fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b75d7a5-152f-4db9-bf19-5fe279a322e3+12:9938:x1877696158128896:12345-192.168.206.46@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790710826.142464:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c80fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b75d7a5-152f-4db9-bf19-5fe279a322e3+12:9938:x1877696158128896:12345-192.168.206.46@tcp:502:llog_process_th.0 Request processed in 263us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710826.142472:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 272 00000100:00100000:2.0:1790710826.151725:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710826.166748:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158129024 00000100:00100000:0.0:1790710826.166763:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158129024 00000100:00100000:0.0:1790710826.166825:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 273 00000100:00100000:0.0:1790710826.166836:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c80f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b75d7a5-152f-4db9-bf19-5fe279a322e3+12:5596:x1877696158129024:12345-192.168.206.46@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790710826.166855:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790710826.166873:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c51c0030800/0xcbad34b281570f8e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x566877b05700041d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710826.166901:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c51c0030800/0xcbad34b281570f8e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700041d expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710826.166912:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c51c0030800/0xcbad34b281570f8e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700041d expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710826.166921:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c0030800, rc 0) 00000100:00100000:0.0:1790710826.167668:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c80f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b75d7a5-152f-4db9-bf19-5fe279a322e3+13:5596:x1877696158129024:12345-192.168.206.46@tcp:101:ll_cfg_requeue.0 Request processed in 831us (15947us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710826.167676:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 273 00000100:00100000:1.0:1790710826.180504:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710826.180623:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158129152 00000100:00100000:0.0:1790710826.180632:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158129152 00000100:00100000:0.0:1790710826.180688:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 274 00000100:00100000:0.0:1790710826.180698:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c80f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b75d7a5-152f-4db9-bf19-5fe279a322e3+13:5596:x1877696158129152:12345-192.168.206.46@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790710826.181079:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c80f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b75d7a5-152f-4db9-bf19-5fe279a322e3+13:5596:x1877696158129152:12345-192.168.206.46@tcp:501:ll_cfg_requeue.0 Request processed in 380us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710826.181088:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 274 00000100:00100000:3.0:1790710826.187308:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710826.187458:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158129280 00000100:00100000:0.0:1790710826.187467:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158129280 00000100:00100000:0.0:1790710826.187523:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 275 00000100:00100000:0.0:1790710826.187533:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c80fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b75d7a5-152f-4db9-bf19-5fe279a322e3+13:5596:x1877696158129280:12345-192.168.206.46@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790710826.187744:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c80fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b75d7a5-152f-4db9-bf19-5fe279a322e3+13:5596:x1877696158129280:12345-192.168.206.46@tcp:503:ll_cfg_requeue.0 Request processed in 211us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710826.187752:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 275 00000100:00100000:0.0:1790710826.202809:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710826.203411:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158129408 00000100:00100000:1.0:1790710826.203422:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158129408 00000100:00100000:1.0:1790710826.203476:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 276 00000100:00100000:1.0:1790710826.203485:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c80fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b75d7a5-152f-4db9-bf19-5fe279a322e3+13:9941:x1877696158129408:12345-192.168.206.46@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790710826.203765:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c80fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b75d7a5-152f-4db9-bf19-5fe279a322e3+13:9941:x1877696158129408:12345-192.168.206.46@tcp:502:llog_process_th.0 Request processed in 280us (963us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710826.203774:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 276 00000100:00100000:2.0:1790710826.215728:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710826.215965:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158129536 00000100:00100000:3.0:1790710826.215974:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158129536 00000100:00100000:3.0:1790710826.216073:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 277 00000100:00100000:3.0:1790710826.216083:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c80f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b75d7a5-152f-4db9-bf19-5fe279a322e3+13:9941:x1877696158129536:12345-192.168.206.46@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790710826.216344:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c80f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b75d7a5-152f-4db9-bf19-5fe279a322e3+13:9941:x1877696158129536:12345-192.168.206.46@tcp:502:llog_process_th.0 Request processed in 262us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710826.216351:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 277 00010000:00010000:1.0:1790710826.503264:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790710827.208301:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1790710827.527905:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790710828.551529:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790710829.575398:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790710829.831441:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4864380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1877696177038464:0@lo:400:kworker.0 00000100:00100000:2.0:1790710829.831640:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710829.831704:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1790710829.831711:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4865880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877696177038336:0@lo:400:kworker.0 00000100:00100000:2.0:1790710829.831735:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710829.831765:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4866680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1877696177038848:0@lo:400:kworker.0 00000100:00100000:2.0:1790710829.831790:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710829.831826:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177038464 00000100:00100000:2.0:1790710829.831834:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177038464 00000100:00100000:2.0:1790710829.831881:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177038336 00000100:00100000:2.0:1790710829.831884:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177038336 00000100:00100000:2.0:1790710829.831901:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1790710829.831909:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4867100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1877696177038464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790710829.831957:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4867100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1877696177038464:12345-0@lo:400:kworker.0 Request processed in 48us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710829.831977:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1790710829.831996:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1790710829.832002:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4864a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1877696177038336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790710829.832030:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4864a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1877696177038336:12345-0@lo:400:kworker.0 Request processed in 28us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710829.832036:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1790710829.832055:0:6696:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177038848 00000100:00100000:2.0:1790710829.832059:0:6696:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177038848 00000100:00100000:2.0:1790710829.832083:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1790710829.832089:0:6696:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4864700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1877696177038848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790710829.832117:0:6696:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4864700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1877696177038848:12345-0@lo:400:kworker.0 Request processed in 28us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710829.832123:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1790710829.832191:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4865880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877696177038336:0@lo:400:kworker.0 00000100:00100000:2.0:1790710829.832201:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4866680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1877696177038848:0@lo:400:kworker.0 00000100:00100000:2.0:1790710829.832209:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4864380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1877696177038464:0@lo:400:kworker.0 00000100:00100000:1.0:1790710829.832362:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4865180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d27fc27-b651-404a-bd8c-b798806fb18a:3312:1877696177038208:0@lo:400:kworker.0 00000100:00100000:1.0:1790710829.832406:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710829.832435:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4867480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1877696177038720:0@lo:400:kworker.0 00000100:00100000:1.0:1790710829.832457:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710829.832480:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790710829.832486:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4866d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1877696177038592:0@lo:400:kworker.0 00000100:00100000:1.0:1790710829.832507:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710829.832653:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177038208 00000100:00100000:0.0:1790710829.832658:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177038208 00000100:00100000:0.0:1790710829.832691:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1790710829.832698:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c80f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+19:3312:x1877696177038208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790710829.832732:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c80f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+19:3312:x1877696177038208:12345-0@lo:400:kworker.0 Request processed in 34us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710829.832738:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00080000:0.0:1790710829.832777:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790710829.832781:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790710829.832851:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4865180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d27fc27-b651-404a-bd8c-b798806fb18a:3312:1877696177038208:0@lo:400:kworker.0 00000100:00100000:0.0:1790710829.832970:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177038592 00000100:00100000:0.0:1790710829.832975:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177038592 00000100:00100000:0.0:1790710829.833013:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1790710829.833027:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9b05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1877696177038592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790710829.833061:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9b05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1877696177038592:12345-0@lo:400:kworker.0 Request processed in 36us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710829.833067:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:1.0:1790710829.833170:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790710829.833191:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51f4866d80 x1877696177038592/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790710845 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790710829.833203:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4866d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1877696177038592:0@lo:400:kworker.0 00000100:00100000:3.0:1790710829.833275:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177038720 00000100:00100000:3.0:1790710829.833279:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177038720 00000100:00100000:3.0:1790710829.833327:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1790710829.833334:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9b05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1877696177038720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790710829.833399:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9b05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1877696177038720:12345-0@lo:400:kworker.0 Request processed in 65us (939us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710829.833405:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1790710829.833431:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4867480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1877696177038720:0@lo:400:kworker.0 00000100:00080000:1.0:1790710829.833628:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790710830.343609:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790710830.343632:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4864380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1877696177038976:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790710830.343698:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710830.343765:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177038976 00000100:00100000:1.0:1790710830.343772:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177038976 00000100:00100000:1.0:1790710830.343815:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1790710830.343824:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9b07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877696177038976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790710830.343858:0:6700:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790710830.343898:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9b07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877696177038976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710830.343905:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1790710830.343951:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4864380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1877696177038976:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1790710830.599364:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790710830.856369:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4e6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177039104:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790710830.856448:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710830.856815:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177039104 00000100:00100000:1.0:1790710830.856824:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177039104 00000100:00100000:1.0:1790710830.856881:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1790710830.856892:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d032c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877696177039104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790710830.856931:0:6700:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790710830.856986:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d032c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877696177039104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710830.856993:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:3.0:1790710830.857150:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51f4e6d180 x1877696177039104/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790710846 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790710830.857176:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4e6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177039104:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790710831.071921:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710831.072281:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158129664 00000100:00100000:0.0:1790710831.072291:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158129664 00000100:00100000:0.0:1790710831.072424:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 279 00000100:00100000:0.0:1790710831.072435:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ee788050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b75d7a5-152f-4db9-bf19-5fe279a322e3+13:2356:x1877696158129664:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:0.0:1790710831.072512:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ee788050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b75d7a5-152f-4db9-bf19-5fe279a322e3+13:2356:x1877696158129664:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 79us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710831.073003:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 279 00000100:00100000:3.0:1790710831.073118:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710831.073929:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158129920 00000100:00100000:2.0:1790710831.073946:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158129920 00000100:00100000:2.0:1790710831.074001:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 61 00000100:00100000:2.0:1790710831.074009:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d032df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+5:2356:x1877696158129920:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:2.0:1790710831.074061:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d032df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+5:2356:x1877696158129920:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 53us (944us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710831.074068:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 61 00000100:00080000:2.0:1790710831.074097:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790710831.074253:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710831.074322:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710831.074354:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158129792 00000100:00100000:3.0:1790710831.074359:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158129792 00000100:00100000:2.0:1790710831.074372:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158130048 00000100:00100000:2.0:1790710831.074381:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158130048 00000100:00100000:3.0:1790710831.074395:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 112 00000100:00100000:2.0:1790710831.074441:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 113 00000100:00100000:3.0:1790710831.075331:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d032ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+5:2356:x1877696158129792:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:3.0:1790710831.075397:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d032ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+5:2356:x1877696158129792:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 994us (1145us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710831.075405:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 112 00000100:00080000:3.0:1790710831.075427:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790710831.083983:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d032ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1b59f23d-9a5c-439d-bd4a-453bf2315b97+5:2356:x1877696158130048:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:2.0:1790710831.084085:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d032ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1b59f23d-9a5c-439d-bd4a-453bf2315b97+5:2356:x1877696158130048:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 9635us (9760us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710831.084095:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 113 00010000:00010000:1.0:1790710831.623289:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790710832.648901:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710833.671921:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710834.699007:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790710834.951376:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4865880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877696177039360:0@lo:400:kworker.0 00000100:00100000:2.0:1790710834.951383:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4865f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1877696177039488:0@lo:400:kworker.0 00000100:00100000:0.0:1790710834.951467:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4866680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d27fc27-b651-404a-bd8c-b798806fb18a:3312:1877696177039232:0@lo:400:kworker.0 00000100:00100000:3.0:1790710834.953533:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4864e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177039616:0@lo:400:kworker.0 00000100:00100000:1.0:1790710834.955692:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710834.955737:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710834.955795:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4864000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1877696177039744:0@lo:400:kworker.0 00000100:00100000:0.0:1790710834.955858:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177039232 00000100:00100000:0.0:1790710834.955865:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177039232 00000100:00100000:0.0:1790710834.955918:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1790710834.955928:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ee78b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+19:3312:x1877696177039232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790710834.955982:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ee78b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+19:3312:x1877696177039232:12345-0@lo:400:kworker.0 Request processed in 55us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710834.955990:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1790710834.956395:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4864380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1877696177039872:0@lo:400:kworker.0 00000100:00100000:1.0:1790710834.956425:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710834.958475:0:6696:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177039872 00000100:00100000:1.0:1790710834.958487:0:6696:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177039872 00000100:00100000:1.0:1790710834.958554:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1790710834.958563:0:6696:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4e6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1877696177039872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790710834.958651:0:6696:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4e6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1877696177039872:12345-0@lo:400:kworker.0 Request processed in 89us (2224us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710834.958658:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1790710834.958708:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177039360 00000100:00100000:1.0:1790710834.958709:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4864380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1877696177039872:0@lo:400:kworker.0 00000100:00100000:0.0:1790710834.958717:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177039360 00000100:00100000:1.0:1790710834.958744:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710834.958791:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4866680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d27fc27-b651-404a-bd8c-b798806fb18a:3312:1877696177039232:0@lo:400:kworker.0 00000100:00100000:2.0:1790710834.962466:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710834.964146:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177039744 00000100:00100000:0.0:1790710834.964161:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177039744 00000100:00100000:0.0:1790710834.964334:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1790710834.964352:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1790710834.964360:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4e6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877696177039360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790710834.964363:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4e6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1877696177039744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790710834.964524:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4e6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1877696177039744:12345-0@lo:400:kworker.0 Request processed in 164us (5780us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710834.964524:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4e6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877696177039360:12345-0@lo:400:kworker.0 Request processed in 169us (8837us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710834.964532:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1790710834.964540:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1790710834.964575:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710834.964581:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4864000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1877696177039744:0@lo:400:kworker.0 00000100:00080000:0.0:1790710834.964622:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790710834.964627:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790710834.964830:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4865880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877696177039360:0@lo:400:kworker.0 00000100:00100000:0.0:1790710834.964864:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177039616 00000100:00100000:0.0:1790710834.964868:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177039616 00000100:00100000:0.0:1790710834.966175:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1790710834.966190:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c75df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1877696177039616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790710834.966266:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c75df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1877696177039616:12345-0@lo:400:kworker.0 Request processed in 82us (1690us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710834.966273:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:0.0:1790710834.966327:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51f4864e00 x1877696177039616/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790710850 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790710834.966340:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4864e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177039616:0@lo:400:kworker.0 00000100:00080000:3.0:1790710834.966398:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790710834.968471:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177039488 00000100:00100000:3.0:1790710834.968483:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177039488 00000100:00100000:3.0:1790710834.968552:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1790710834.968575:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4867480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1877696177039488:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1790710834.968658:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790710834.968670:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4867480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1877696177039488:12345-0@lo:400:kworker.0 Request processed in 97us (6211us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710834.968679:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1790710834.968715:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4865f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1877696177039488:0@lo:400:kworker.0 00000100:00100000:1.0:1790710835.463730:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790710835.463751:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4865f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1877696177040000:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790710835.463816:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710835.463955:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177040000 00000100:00100000:2.0:1790710835.463962:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177040000 00000100:00100000:2.0:1790710835.464011:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1790710835.464021:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4e6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877696177040000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790710835.464055:0:6700:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790710835.464111:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4e6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877696177040000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710835.464118:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1790710835.464383:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4865f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1877696177040000:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1790710835.719278:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790710835.975759:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4e6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177040128:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790710835.975820:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710835.975999:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177040128 00000100:00100000:2.0:1790710835.976007:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177040128 00000100:00100000:2.0:1790710835.976052:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1790710835.976061:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c75dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877696177040128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790710835.976094:0:6700:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790710835.976177:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c75dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877696177040128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710835.976183:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:0.0:1790710835.976338:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51f4e6c000 x1877696177040128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790710851 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790710835.976356:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4e6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177040128:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790710836.189016:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710836.189055:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710836.189091:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710836.189114:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710836.189178:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158130432 00000100:00100000:3.0:1790710836.189189:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158130432 00000100:00100000:3.0:1790710836.189242:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 64 00000100:00100000:3.0:1790710836.189252:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff1ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+5:2357:x1877696158130432:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:3.0:1790710836.189377:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff1ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+5:2357:x1877696158130432:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 126us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710836.189385:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 64 00000100:00100000:2.0:1790710836.189515:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158130304 00000100:00100000:2.0:1790710836.189521:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158130304 00000100:00100000:2.0:1790710836.189563:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158130560 00000100:00100000:2.0:1790710836.189567:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158130560 00000100:00100000:2.0:1790710836.189589:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 117 00000100:00100000:2.0:1790710836.189596:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff1ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+5:2357:x1877696158130304:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:2.0:1790710836.189633:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff1ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+5:2357:x1877696158130304:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 38us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710836.189640:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 117 00000100:00100000:2.0:1790710836.189657:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 118 00000100:00100000:2.0:1790710836.189663:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff1af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1b59f23d-9a5c-439d-bd4a-453bf2315b97+5:2357:x1877696158130560:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:2.0:1790710836.189704:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff1af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1b59f23d-9a5c-439d-bd4a-453bf2315b97+5:2357:x1877696158130560:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 26us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710836.189713:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 118 00000100:00100000:0.0:1790710836.189917:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158130176 00000100:00100000:0.0:1790710836.189933:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158130176 00000100:00100000:0.0:1790710836.189978:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 281 00000100:00100000:0.0:1790710836.189987:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ee78ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b75d7a5-152f-4db9-bf19-5fe279a322e3+13:2357:x1877696158130176:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:0.0:1790710836.190018:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ee78ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b75d7a5-152f-4db9-bf19-5fe279a322e3+13:2357:x1877696158130176:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 33us (926us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710836.190025:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 281 00000100:00080000:0.0:1790710836.190056:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790710836.190062:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1790710836.748784:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790710837.447867:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1790710837.767330:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790710838.791375:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710839.815304:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790710840.072538:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c75df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1877696177040512:0@lo:400:kworker.0 00000100:00100000:0.0:1790710840.072610:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710840.072670:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1790710840.072677:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c75dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877696177040384:0@lo:400:kworker.0 00000100:00100000:0.0:1790710840.072700:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710840.072716:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9577b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1877696177040896:0@lo:400:kworker.0 00000100:00100000:0.0:1790710840.072739:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710840.072835:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177040512 00000100:00100000:2.0:1790710840.072844:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177040512 00000100:00100000:2.0:1790710840.072903:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177040384 00000100:00100000:2.0:1790710840.072906:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177040384 00000100:00100000:2.0:1790710840.072932:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1790710840.072941:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9574e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1877696177040512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790710840.072999:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9574e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1877696177040512:12345-0@lo:400:kworker.0 Request processed in 58us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710840.073020:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1790710840.073039:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c75de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d27fc27-b651-404a-bd8c-b798806fb18a:3312:1877696177040256:0@lo:400:kworker.0 00000100:00100000:2.0:1790710840.073046:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1790710840.073054:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c812c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1877696177040384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790710840.073083:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710840.073111:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c812c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1877696177040384:12345-0@lo:400:kworker.0 Request processed in 43us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710840.073114:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9575500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1877696177040768:0@lo:400:kworker.0 00000100:00100000:2.0:1790710840.073124:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1790710840.073170:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710840.073192:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790710840.073197:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c75dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1877696177040640:0@lo:400:kworker.0 00000100:00100000:3.0:1790710840.073218:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710840.073244:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177040256 00000100:00100000:3.0:1790710840.073249:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177040256 00000100:00100000:3.0:1790710840.073279:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1790710840.073302:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ee788c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+19:3312:x1877696177040256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790710840.073339:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ee788c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+19:3312:x1877696177040256:12345-0@lo:400:kworker.0 Request processed in 53us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710840.073346:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1790710840.073373:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177040896 00000100:00100000:3.0:1790710840.073377:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177040896 00000100:00100000:3.0:1790710840.073404:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177040640 00000100:00100000:3.0:1790710840.073407:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177040640 00000100:00100000:2.0:1790710840.073417:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c75dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877696177040384:0@lo:400:kworker.0 00000100:00100000:3.0:1790710840.073431:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1790710840.073435:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c75df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1877696177040512:0@lo:400:kworker.0 00000100:00100000:3.0:1790710840.073442:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c812ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1877696177040896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790710840.073465:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177040768 00000100:00100000:2.0:1790710840.073470:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177040768 00000100:00100000:3.0:1790710840.073487:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c812ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1877696177040896:12345-0@lo:400:kworker.0 Request processed in 47us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710840.073495:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1790710840.073508:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1790710840.073513:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1790710840.073519:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff1aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1877696177040768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790710840.073524:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff1ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1877696177040640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790710840.073567:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff1aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1877696177040768:12345-0@lo:400:kworker.0 Request processed in 50us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710840.073573:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff1ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1877696177040640:12345-0@lo:400:kworker.0 Request processed in 51us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710840.073578:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1790710840.073587:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:0.0:1790710840.073699:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790710840.073704:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790710840.073706:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1790710840.073755:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51c75dd880 x1877696177040640/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790710856 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790710840.073766:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c75dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1877696177040640:0@lo:400:kworker.0 00000100:00100000:2.0:1790710840.073775:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c75de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d27fc27-b651-404a-bd8c-b798806fb18a:3312:1877696177040256:0@lo:400:kworker.0 00000100:00100000:2.0:1790710840.073784:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9575500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1877696177040768:0@lo:400:kworker.0 00000100:00100000:3.0:1790710840.076886:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9577b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1877696177040896:0@lo:400:kworker.0 00000100:00100000:0.0:1790710840.586580:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790710840.586602:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4866d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1877696177041024:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790710840.586669:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710840.587567:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177041024 00000100:00100000:2.0:1790710840.587577:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177041024 00000100:00100000:2.0:1790710840.587700:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1790710840.587724:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c812ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877696177041024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790710840.587769:0:6700:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790710840.587857:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c812ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877696177041024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 135us (1187us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710840.587996:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4866d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1877696177041024:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790710840.588054:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00010000:2.0:1790710840.839432:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790710841.096531:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4e6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177041152:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790710841.096598:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710841.096822:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177041152 00000100:00100000:1.0:1790710841.096830:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177041152 00000100:00100000:1.0:1790710841.096877:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1790710841.096887:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c812f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877696177041152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790710841.096921:0:6699:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790710841.096988:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c812f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877696177041152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710841.096995:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:0.0:1790710841.097117:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51f4e6c000 x1877696177041152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790710857 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790710841.097167:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4e6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177041152:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790710841.312493:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710841.312540:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710841.312649:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158130688 00000100:00100000:2.0:1790710841.312658:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158130688 00000100:00100000:2.0:1790710841.312718:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 283 00000100:00100000:2.0:1790710841.312729:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ee789450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b75d7a5-152f-4db9-bf19-5fe279a322e3+13:2359:x1877696158130688:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:2.0:1790710841.312810:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ee789450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b75d7a5-152f-4db9-bf19-5fe279a322e3+13:2359:x1877696158130688:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 82us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710841.312818:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 283 00000100:00100000:2.0:1790710841.313658:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158130816 00000100:00100000:2.0:1790710841.313666:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158130816 00000100:00100000:2.0:1790710841.313721:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 122 00000100:00100000:2.0:1790710841.313729:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff1adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+5:2359:x1877696158130816:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:2.0:1790710841.313827:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff1adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+5:2359:x1877696158130816:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 97us (1285us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710841.313835:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 122 00000100:00080000:0.0:1790710841.314235:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790710841.334698:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710841.334806:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710841.334919:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158130944 00000100:00100000:0.0:1790710841.334928:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158130944 00000100:00100000:0.0:1790710841.335003:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 19 00000100:00100000:0.0:1790710841.335016:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff1adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+5:2355:x1877696158130944:12345-192.168.206.46@tcp:9:kworker.0 00000020:00000080:0.0:1790710841.335043:0:6698:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcbad34b281570eca 00000100:00080000:0.0:1790710841.335051:0:6698:0:(import.c:65:import_set_state_nolock()) ffff9c51ff96b000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790710841.335089:0:6698:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:0.0:1790710841.335397:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff1adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+2:2355:x1877696158130944:12345-192.168.206.46@tcp:9:kworker.0 Request processed in 384us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710841.335406:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 19 00010000:00010000:1.0:1790710841.335723:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790710841.335819:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790710841.336782:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158131072 00000100:00100000:2.0:1790710841.336790:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158131072 00000100:00100000:2.0:1790710841.336941:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 123 00000100:00100000:2.0:1790710841.336950:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff1ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1b59f23d-9a5c-439d-bd4a-453bf2315b97+5:2358:x1877696158131072:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:2.0:1790710841.337027:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff1ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1b59f23d-9a5c-439d-bd4a-453bf2315b97+5:2358:x1877696158131072:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 77us (2337us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710841.337049:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 123 00000100:00080000:1.0:1790710841.337619:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1790710841.864073:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1790710842.738299:0:7643:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0ec73bd1-726e-4dc0-8edd-807d3f973d65 00000020:00000080:0.0:1790710842.738308:0:7643:0:(genops.c:885:class_export_put()) final put ffff9c51ff96a800/0ec73bd1-726e-4dc0-8edd-807d3f973d65 00000020:00000080:3.0:1790710842.742026:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9c51ff96a800/0ec73bd1-726e-4dc0-8edd-807d3f973d65 for lustre-OST0001 00000020:00000080:3.0:1790710842.742905:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c51ff96b000 for lustre-OST0001 00010000:00010000:2.0:1790710842.887556:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790710843.911263:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710844.935304:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790710845.191401:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c812d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877696177041408:0@lo:400:kworker.0 00000100:00100000:0.0:1790710845.191507:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710845.191570:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51fef72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1877696177041920:0@lo:400:kworker.0 00000100:00100000:0.0:1790710845.191599:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710845.191643:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790710845.191650:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c812f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1877696177041536:0@lo:400:kworker.0 00000100:00100000:0.0:1790710845.191675:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710845.191714:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177041408 00000100:00100000:0.0:1790710845.191724:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177041408 00000100:00100000:0.0:1790710845.191777:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177041536 00000100:00100000:0.0:1790710845.191780:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177041536 00000100:00100000:0.0:1790710845.191840:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1790710845.191849:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51fef71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877696177041408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790710845.191904:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51fef71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877696177041408:12345-0@lo:400:kworker.0 Request processed in 56us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710845.191910:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1790710845.191926:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1790710845.191932:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51fef70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877696177041536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790710845.191962:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51fef70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877696177041536:12345-0@lo:400:kworker.0 Request processed in 30us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710845.191968:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1790710845.191985:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177041920 00000100:00100000:0.0:1790710845.191988:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177041920 00000100:00100000:0.0:1790710845.192012:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1790710845.192018:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51fef71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1877696177041920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790710845.192055:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51fef71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1877696177041920:12345-0@lo:400:kworker.0 Request processed in 38us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710845.192061:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:0.0:1790710845.192083:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790710845.192088:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790710845.192144:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c812f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1877696177041536:0@lo:400:kworker.0 00000100:00100000:0.0:1790710845.192159:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c812d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877696177041408:0@lo:400:kworker.0 00000100:00100000:0.0:1790710845.192168:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51fef72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1877696177041920:0@lo:400:kworker.0 00000100:00100000:1.0:1790710845.192384:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51fef72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177041664:0@lo:400:kworker.0 00000100:00100000:1.0:1790710845.192414:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710845.192458:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1790710845.192465:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c812ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d27fc27-b651-404a-bd8c-b798806fb18a:3311:1877696177041280:0@lo:400:kworker.0 00000100:00100000:1.0:1790710845.192506:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710845.192527:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51fef72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1877696177041792:0@lo:400:kworker.0 00000100:00100000:1.0:1790710845.192548:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710845.192639:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177041280 00000100:00100000:3.0:1790710845.192644:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177041280 00000100:00100000:3.0:1790710845.192685:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1790710845.192694:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ee78bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+19:3311:x1877696177041280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790710845.192746:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ee78bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+19:3311:x1877696177041280:12345-0@lo:400:kworker.0 Request processed in 54us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710845.192752:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1790710845.192793:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c812ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d27fc27-b651-404a-bd8c-b798806fb18a:3311:1877696177041280:0@lo:400:kworker.0 00000100:00100000:0.0:1790710845.193022:0:6696:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177041664 00000100:00100000:0.0:1790710845.193027:0:6696:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177041664 00000100:00100000:0.0:1790710845.193102:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1790710845.193110:0:6696:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4e6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1877696177041664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790710845.193192:0:6696:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4e6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1877696177041664:12345-0@lo:400:kworker.0 Request processed in 83us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710845.193198:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1790710845.193218:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177041792 00000100:00100000:0.0:1790710845.193221:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177041792 00010000:00080000:3.0:1790710845.197643:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51fef72d80 x1877696177041664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790710861 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790710845.197659:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51fef72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177041664:0@lo:400:kworker.0 00000100:00080000:1.0:1790710845.197766:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790710845.197773:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790710845.198009:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1790710845.198021:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4e6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1877696177041792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790710845.198104:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4e6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1877696177041792:12345-0@lo:400:kworker.0 Request processed in 86us (5554us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710845.198111:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1790710845.200419:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51fef72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1877696177041792:0@lo:400:kworker.0 00000100:00100000:2.0:1790710845.703439:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790710845.703459:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4865180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1877696177042048:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790710845.703523:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710845.703591:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177042048 00000100:00100000:2.0:1790710845.703599:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177042048 00000100:00100000:2.0:1790710845.703643:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1790710845.703651:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4866d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877696177042048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790710845.703686:0:6699:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790710845.703729:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4866d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877696177042048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710845.703736:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1790710845.703784:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4865180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1877696177042048:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1790710845.964244:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790710846.215582:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c652b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177042176:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790710846.215650:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710846.215866:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177042176 00000100:00100000:1.0:1790710846.215874:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177042176 00000100:00100000:1.0:1790710846.215933:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1790710846.215943:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4865180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877696177042176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790710846.215979:0:6699:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790710846.216029:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4865180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877696177042176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710846.216036:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:1.0:1790710846.216074:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51c652b480 x1877696177042176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790710862 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790710846.216091:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c652b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177042176:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790710846.431299:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710846.431331:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710846.431349:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158131200 00000100:00100000:0.0:1790710846.431360:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158131200 00000100:00100000:3.0:1790710846.431361:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710846.431426:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 285 00000100:00100000:0.0:1790710846.431437:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ee78a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b75d7a5-152f-4db9-bf19-5fe279a322e3+13:2358:x1877696158131200:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:0.0:1790710846.431511:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ee78a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b75d7a5-152f-4db9-bf19-5fe279a322e3+13:2358:x1877696158131200:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 76us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710846.431520:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 285 00000100:00100000:0.0:1790710846.431663:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158131456 00000100:00100000:0.0:1790710846.431668:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158131456 00000100:00100000:0.0:1790710846.431712:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158131328 00000100:00100000:0.0:1790710846.431715:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158131328 00000100:00100000:0.0:1790710846.431736:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 127 00000100:00100000:0.0:1790710846.431743:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff1ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1b59f23d-9a5c-439d-bd4a-453bf2315b97+5:2358:x1877696158131456:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:0.0:1790710846.431774:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff1ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1b59f23d-9a5c-439d-bd4a-453bf2315b97+5:2358:x1877696158131456:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 32us (443us total) trans 0 rc 0/0 00000100:00080000:3.0:1790710846.431867:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790710846.431939:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 127 00000100:00100000:0.0:1790710846.431961:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 128 00000100:00100000:0.0:1790710846.431979:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff1afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+5:2358:x1877696158131328:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:0.0:1790710846.432006:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff1afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+5:2358:x1877696158131328:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 39us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710846.432012:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 128 00010000:00010000:1.0:1790710846.983319:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790710847.693227:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1790710848.009279:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790710848.347982:0:11840:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 15:40:46 (1790710846) 00010000:00010000:2.0:1790710849.032990:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790710849.939936:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710849.940273:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158131584 00000100:00100000:2.0:1790710849.940287:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158131584 00000100:00100000:2.0:1790710849.940375:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 32 00000100:00100000:2.0:1790710849.940388:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51fef72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+5:10209:x1877696158131584:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790710849.940425:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790710849.940500:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047000/0xcbad34b281570f95 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b057000424 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710849.940561:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b281570f9c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710849.940577:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b281570f9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710849.940589:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b281570f9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790710849.940619:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790710849.940623:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790710849.940679:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b281570f9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710849.940703:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047000/0xcbad34b281570f95 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000424 expref: 7 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710849.940721:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b281570f9c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000424 expref: 6 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710849.940730:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c51cca25700) 00010000:00010000:2.0:1790710849.940733:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790710849.940736:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c8047a00, rc 0) 00000100:00100000:2.0:1790710849.940809:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51fef72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:10209:x1877696158131584:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 Request processed in 425us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710849.940825:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 32 00000100:00080000:3.0:1790710849.941584:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790710849.946712:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710849.946801:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158131712 00000100:00100000:3.0:1790710849.946812:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158131712 00000100:00100000:3.0:1790710849.946912:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 33 00000100:00100000:3.0:1790710849.946922:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51fef71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:10210:x1877696158131712:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790710849.946942:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790710849.946962:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216a600/0xcbad34b281570fa3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b05700042b expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710849.947041:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216be00/0xcbad34b281570faa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710849.947067:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216be00/0xcbad34b281570faa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710849.947079:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216be00/0xcbad34b281570faa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710849.947094:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216b600/0xcbad34b281570fb1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710849.947102:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216b600/0xcbad34b281570fb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710849.947108:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216b600/0xcbad34b281570fb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710849.947372:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216b400/0xcbad34b281570fb8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710849.947382:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216b400/0xcbad34b281570fb8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710849.947390:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216b400/0xcbad34b281570fb8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790710849.947415:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790710849.947419:0:5845:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790710849.947439:0:5845:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216b400/0xcbad34b281570fb8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710849.947449:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216be00/0xcbad34b281570faa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710849.947464:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216be00/0xcbad34b281570faa lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710849.947471:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216be00/0xcbad34b281570faa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710849.947478:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c520216be00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1790710849.947482:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216be00/0xcbad34b281570faa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710849.947491:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216be00/0xcbad34b281570faa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710849.947502:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c51cca25700) 00010000:00010000:3.0:1790710849.947505:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790710849.947511:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216be00/0xcbad34b281570faa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710849.947517:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216be00/0xcbad34b281570faa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710849.947529:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216b600/0xcbad34b281570fb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710849.947535:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216b600/0xcbad34b281570fb1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710849.947541:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216b600/0xcbad34b281570fb1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710849.947546:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c520216b600 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1790710849.947554:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216b600/0xcbad34b281570fb1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710849.947560:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216b600/0xcbad34b281570fb1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710849.947567:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9c51c2c2eb00) 00010000:00010000:3.0:1790710849.947570:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790710849.947572:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216b600/0xcbad34b281570fb1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710849.947578:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216b600/0xcbad34b281570fb1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710849.947608:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216a600/0xcbad34b281570fa3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700042b expref: 8 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710849.947621:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216b400/0xcbad34b281570fb8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700042b expref: 7 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710849.947629:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c51c2c2e500) 00010000:00010000:3.0:1790710849.947631:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790710849.947634:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c520216b400, rc 0) 00000100:00100000:3.0:1790710849.947702:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51fef71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+7:10210:x1877696158131712:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 Request processed in 780us (1000us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710849.947710:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 33 00000100:00100000:1.0:1790710849.964271:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710849.964507:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158131968 00000100:00100000:2.0:1790710849.964517:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158131968 00000100:00100000:2.0:1790710849.964579:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 34 00000100:00100000:2.0:1790710849.964589:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c652b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+7:10210:x1877696158131968:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790710849.964609:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790710849.964627:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047000/0xcbad34b281570fbf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b057000432 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710849.964695:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b281570fc6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710849.964710:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b281570fc6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710849.964722:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b281570fc6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710849.964792:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b281570fcd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710849.964800:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b281570fcd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710849.964807:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b281570fcd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710849.965350:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046a00/0xcbad34b281570fd4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710849.965371:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046a00/0xcbad34b281570fd4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710849.965378:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046a00/0xcbad34b281570fd4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790710849.965389:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1790710849.965532:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b281570fc6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710849.965540:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b281570fc6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710849.965547:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b281570fc6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710849.965554:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c8046800 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1790710849.965559:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b281570fc6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710849.965566:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b281570fc6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710849.965578:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c51c2c2e500) 00010000:00010000:2.0:1790710849.965581:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790710849.965586:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b281570fc6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710849.965592:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b281570fc6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710849.965604:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b281570fcd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710849.965616:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b281570fcd lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710849.965622:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b281570fcd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710849.965627:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c8046e00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1790710849.965630:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b281570fcd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710849.965637:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b281570fcd lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710849.965645:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9c51cca25800) 00010000:00010000:2.0:1790710849.965647:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790710849.965650:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b281570fcd lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710849.965655:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b281570fcd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710849.966091:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047000/0xcbad34b281570fbf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000432 expref: 10 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710849.966107:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046a00/0xcbad34b281570fd4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000432 expref: 9 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710849.966114:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c51cca25300) 00010000:00010000:2.0:1790710849.966116:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790710849.967071:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c8046a00, rc 0) 00000100:00100000:2.0:1790710849.967502:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c652b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+9:10210:x1877696158131968:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 Request processed in 2911us (3236us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1790710849.967511:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 34 00000100:00100000:1.0:1790710849.978505:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710849.978599:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158132096 00000100:00100000:0.0:1790710849.978608:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158132096 00000100:00100000:0.0:1790710849.978664:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 35 00000100:00100000:0.0:1790710849.978674:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c652a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+9:10210:x1877696158132096:12345-192.168.206.46@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1790710849.978777:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c652a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+9:10210:x1877696158132096:12345-192.168.206.46@tcp:59:lhsmtool_posix.0 Request processed in 104us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710849.978784:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 35 00010000:00010000:2.0:1790710850.068247:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790710850.312184:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51ff1ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177042688:0@lo:400:kworker.0 00000100:00100000:3.0:1790710850.312261:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710850.312312:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1790710850.312330:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51ff1ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d27fc27-b651-404a-bd8c-b798806fb18a:3311:1877696177042304:0@lo:400:kworker.0 00000100:00100000:3.0:1790710850.312826:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710850.312856:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51ff1ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1877696177042816:0@lo:400:kworker.0 00000100:00100000:3.0:1790710850.312884:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710850.312914:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51ff1aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877696177042432:0@lo:400:kworker.0 00000100:00100000:3.0:1790710850.312954:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710850.312978:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51ff1ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1877696177042944:0@lo:400:kworker.0 00000100:00100000:3.0:1790710850.313013:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710850.313032:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790710850.313038:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51ff1af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1877696177042560:0@lo:400:kworker.0 00000100:00100000:3.0:1790710850.313059:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710850.313200:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177042304 00000100:00100000:3.0:1790710850.313207:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177042304 00000100:00100000:3.0:1790710850.313265:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1790710850.313275:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ee78b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+19:3311:x1877696177042304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790710850.313328:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ee78b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+19:3311:x1877696177042304:12345-0@lo:400:kworker.0 Request processed in 54us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710850.313336:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1790710850.313389:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51ff1ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d27fc27-b651-404a-bd8c-b798806fb18a:3311:1877696177042304:0@lo:400:kworker.0 00000100:00100000:3.0:1790710850.313424:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177042816 00000100:00100000:3.0:1790710850.313427:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177042816 00000100:00100000:3.0:1790710850.313469:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177042432 00000100:00100000:3.0:1790710850.313473:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177042432 00000100:00100000:3.0:1790710850.313484:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177042560 00000100:00100000:3.0:1790710850.313486:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177042560 00000100:00100000:3.0:1790710850.313504:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1790710850.313510:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff1af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1877696177042816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790710850.313558:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff1af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1877696177042816:12345-0@lo:400:kworker.0 Request processed in 48us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710850.313564:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1790710850.313577:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1790710850.313584:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c652ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877696177042432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790710850.313616:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c652ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877696177042432:12345-0@lo:400:kworker.0 Request processed in 33us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710850.313622:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1790710850.313633:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1790710850.313639:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c652d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877696177042560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790710850.313666:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c652d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877696177042560:12345-0@lo:400:kworker.0 Request processed in 28us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710850.313672:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:3.0:1790710850.313687:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790710850.313709:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51ff1ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1877696177042816:0@lo:400:kworker.0 00000100:00100000:3.0:1790710850.313730:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51ff1af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1877696177042560:0@lo:400:kworker.0 00000100:00100000:3.0:1790710850.313740:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51ff1aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877696177042432:0@lo:400:kworker.0 00000100:00100000:0.0:1790710850.314015:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177042688 00000100:00100000:0.0:1790710850.314020:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177042688 00000100:00100000:0.0:1790710850.314063:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177042944 00000100:00100000:0.0:1790710850.314067:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177042944 00000100:00100000:0.0:1790710850.314096:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1790710850.314103:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff1aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1877696177042688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790710850.314173:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff1aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1877696177042688:12345-0@lo:400:kworker.0 Request processed in 70us (1911us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710850.314180:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1790710850.314193:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1790710850.314199:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c652f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1877696177042944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790710850.314232:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c652f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1877696177042944:12345-0@lo:400:kworker.0 Request processed in 33us (1217us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710850.314256:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:3.0:1790710850.314488:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790710850.314492:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1790710850.314516:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51ff1ad180 x1877696177042688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790710866 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790710850.314528:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51ff1ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177042688:0@lo:400:kworker.0 00000100:00100000:3.0:1790710850.314555:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51ff1ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1877696177042944:0@lo:400:kworker.0 00000040:00080000:3.0:1790710850.761606:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1790710850.823401:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790710850.823424:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4865f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1877696177043072:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790710850.823495:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710850.823622:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177043072 00000100:00100000:2.0:1790710850.823630:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177043072 00000100:00100000:2.0:1790710850.823680:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1790710850.823690:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c652b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877696177043072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790710850.823728:0:6699:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790710850.823782:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c652b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877696177043072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710850.823789:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1790710850.823866:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4865f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1877696177043072:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1790710851.079994:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790710851.336098:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790710851.336119:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4864e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1877696177043200:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790710851.336212:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710851.336281:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177043200 00000100:00100000:2.0:1790710851.336288:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177043200 00000100:00100000:2.0:1790710851.336331:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1790710851.336340:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4865880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877696177043200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790710851.336378:0:6699:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790710851.336425:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4865880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877696177043200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710851.336432:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:2.0:1790710851.336475:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51f4864e00 x1877696177043200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790710867 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790710851.336510:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4864e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1877696177043200:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790710851.551795:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710851.551840:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710851.551872:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710851.551901:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158132352 00000100:00100000:0.0:1790710851.551910:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158132352 00000100:00100000:0.0:1790710851.551962:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158132480 00000100:00100000:0.0:1790710851.551965:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158132480 00000100:00100000:0.0:1790710851.551988:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 132 00000100:00100000:0.0:1790710851.551997:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51fef72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+9:2356:x1877696158132352:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:0.0:1790710851.552058:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51fef72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+9:2356:x1877696158132352:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 62us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710851.552065:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 132 00000100:00100000:0.0:1790710851.552079:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 133 00000100:00100000:0.0:1790710851.552085:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51fef72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1b59f23d-9a5c-439d-bd4a-453bf2315b97+5:2356:x1877696158132480:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:0.0:1790710851.552102:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51fef72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1b59f23d-9a5c-439d-bd4a-453bf2315b97+5:2356:x1877696158132480:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 18us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710851.552108:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 133 00000100:00080000:0.0:1790710851.552121:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790710851.552376:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158132224 00000100:00100000:1.0:1790710851.552380:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158132224 00000100:00100000:1.0:1790710851.552406:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 287 00000100:00100000:1.0:1790710851.552424:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ee78a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b75d7a5-152f-4db9-bf19-5fe279a322e3+13:2356:x1877696158132224:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:1.0:1790710851.552448:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ee78a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b75d7a5-152f-4db9-bf19-5fe279a322e3+13:2356:x1877696158132224:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 26us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710851.552454:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 287 00000100:00100000:0.0:1790710851.831936:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710851.832345:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158132608 00000100:00100000:3.0:1790710851.832355:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158132608 00000100:00100000:3.0:1790710851.832409:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 36 00000100:00100000:3.0:1790710851.832419:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c812ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+9:10253:x1877696158132608:12345-192.168.206.46@tcp:101:lfs.0 00010000:00010000:3.0:1790710851.832439:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790710851.832459:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216a600/0xcbad34b281570fe2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b057000439 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710851.832524:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216b600/0xcbad34b281570fe9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710851.832537:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216b600/0xcbad34b281570fe9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710851.832548:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216b600/0xcbad34b281570fe9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710851.832561:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216be00/0xcbad34b281570ff0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710851.832567:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216be00/0xcbad34b281570ff0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710851.832573:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216be00/0xcbad34b281570ff0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710851.832760:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216b600/0xcbad34b281570fe9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710851.832768:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216b600/0xcbad34b281570fe9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710851.832780:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216b600/0xcbad34b281570fe9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710851.832786:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c520216b600 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1790710851.832789:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216b600/0xcbad34b281570fe9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710851.832797:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216b600/0xcbad34b281570fe9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710851.832808:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c51cca25700) 00010000:00010000:3.0:1790710851.832811:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790710851.832814:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216b600/0xcbad34b281570fe9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710851.832820:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216b600/0xcbad34b281570fe9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710851.832830:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216be00/0xcbad34b281570ff0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710851.832836:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216be00/0xcbad34b281570ff0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710851.832841:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216be00/0xcbad34b281570ff0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710851.832845:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c520216be00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1790710851.832848:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216be00/0xcbad34b281570ff0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710851.832860:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216be00/0xcbad34b281570ff0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710851.832867:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9c51c2c2eb00) 00010000:00010000:3.0:1790710851.832869:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790710851.832872:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216be00/0xcbad34b281570ff0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710851.832877:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216be00/0xcbad34b281570ff0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710851.832904:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216a600/0xcbad34b281570fe2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000439 expref: 10 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710851.832913:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c51cca25700) 00010000:00010000:3.0:1790710851.832915:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790710851.832919:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216a600/0xcbad34b281570fe2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000439 expref: 10 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710851.832927:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c520216a600, rc 0) 00000100:00100000:3.0:1790710851.833895:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c812ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+9:10253:x1877696158132608:12345-192.168.206.46@tcp:101:lfs.0 Request processed in 1471us (1966us total) trans 0 rc 301/301 00000100:00100000:3.0:1790710851.833906:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 36 00000100:00100000:2.0:1790710851.856146:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710851.857557:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158132864 00000100:00100000:1.0:1790710851.857570:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158132864 00000100:00100000:1.0:1790710851.857633:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 37 00000100:00100000:1.0:1790710851.857644:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4864e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+9:10253:x1877696158132864:12345-192.168.206.46@tcp:36:lfs.0 00010000:00010000:1.0:1790710851.857697:0:8060:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790710851.857720:0:8060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b281570f9c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000424 expref: 9 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710851.857741:0:8060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c51cca25700) 00010000:00010000:1.0:1790710851.857752:0:8060:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790710851.857967:0:8060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b281570ff7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710851.857980:0:8060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b281570ff7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710851.857990:0:8060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b281570ff7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710851.858003:0:8060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480400/0xcbad34b281570ffe lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710851.858010:0:8060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480400/0xcbad34b281570ffe lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710851.858017:0:8060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480400/0xcbad34b281570ffe lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790710851.859935:0:8060:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1790710851.859951:0:8060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b281570ff7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710851.859962:0:8060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b281570ff7 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710851.859970:0:8060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b281570ff7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710851.859977:0:8060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c6480e00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1790710851.859981:0:8060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b281570ff7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710851.859990:0:8060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b281570ff7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710851.860011:0:8060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c51d8e33600) 00010000:00010000:1.0:1790710851.860014:0:8060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790710851.860019:0:8060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b281570ff7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710851.860025:0:8060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b281570ff7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790710851.860045:0:8060:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000002cd21c48 reply state 0000000013ebdda7 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480400/0xcbad34b281570ffe lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710851.860055:0:8060:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790710851.861438:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4864e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+10:10253:x1877696158132864:12345-192.168.206.46@tcp:36:lfs.0 Request processed in 3786us (5303us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1790710851.861450:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 37 00010000:00010000:2.0:1790710851.871623:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480400/0xcbad34b281570ffe lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710851.871641:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480400/0xcbad34b281570ffe lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710851.871650:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480400/0xcbad34b281570ffe lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710851.871657:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c6480400 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1790710851.871662:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480400/0xcbad34b281570ffe lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710851.871670:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480400/0xcbad34b281570ffe lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710851.871685:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9c51d8e33b00) 00010000:00010000:2.0:1790710851.871689:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790710851.871694:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480400/0xcbad34b281570ffe lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710851.871701:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480400/0xcbad34b281570ffe lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710851.980380:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710851.980591:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158132992 00000100:00100000:1.0:1790710851.980601:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158132992 00000100:00100000:1.0:1790710851.980669:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 38 00000100:00100000:1.0:1790710851.980679:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c652d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+9:10261:x1877696158132992:12345-192.168.206.46@tcp:101:lctl.0 00010000:00010000:1.0:1790710851.980702:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790710851.980724:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b281571005 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b057000440 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710851.980786:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480400/0xcbad34b28157100c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710851.980800:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480400/0xcbad34b28157100c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710851.980828:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480400/0xcbad34b28157100c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790710851.980862:0:5846:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1790710851.980866:0:5846:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790710851.980900:0:5846:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480400/0xcbad34b28157100c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710851.980922:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b281571005 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000440 expref: 11 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710851.980940:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480400/0xcbad34b28157100c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000440 expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710851.980949:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c51d8e33600) 00010000:00010000:1.0:1790710851.980952:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790710851.980955:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c6480400, rc 0) 00000100:00100000:1.0:1790710851.981017:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c652d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+10:10261:x1877696158132992:12345-192.168.206.46@tcp:101:lctl.0 Request processed in 338us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710851.981024:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 38 00000100:00100000:0.0:1790710852.031369:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710852.031458:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158133120 00000100:00100000:3.0:1790710852.031468:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158133120 00000100:00100000:3.0:1790710852.031528:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 39 00000100:00100000:3.0:1790710852.031538:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c812d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+10:10267:x1877696158133120:12345-192.168.206.46@tcp:101:bash.0 00010000:00010000:3.0:1790710852.031574:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790710852.031594:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216a600/0xcbad34b281571013 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b057000447 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710852.031653:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216be00/0xcbad34b28157101a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710852.031667:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216be00/0xcbad34b28157101a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710852.031677:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216be00/0xcbad34b28157101a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710852.031691:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216b600/0xcbad34b281571021 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710852.031699:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216b600/0xcbad34b281571021 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710852.031706:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216b600/0xcbad34b281571021 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710852.031797:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216a800/0xcbad34b281571028 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710852.031805:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216a800/0xcbad34b281571028 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710852.031812:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216a800/0xcbad34b281571028 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790710852.031841:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1790710852.031851:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790710852.031889:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216a800/0xcbad34b281571028 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710852.031901:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216be00/0xcbad34b28157101a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710852.031908:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216be00/0xcbad34b28157101a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710852.031914:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216be00/0xcbad34b28157101a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710852.031920:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c520216be00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1790710852.031924:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216be00/0xcbad34b28157101a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710852.031932:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216be00/0xcbad34b28157101a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710852.031943:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c51d8e33600) 00010000:00010000:3.0:1790710852.031946:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790710852.031951:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216be00/0xcbad34b28157101a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710852.031957:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216be00/0xcbad34b28157101a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710852.031969:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216b600/0xcbad34b281571021 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710852.031976:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216b600/0xcbad34b281571021 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710852.031992:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216b600/0xcbad34b281571021 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710852.031997:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c520216b600 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1790710852.031999:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216b600/0xcbad34b281571021 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710852.032005:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216b600/0xcbad34b281571021 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710852.032013:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9c51c2c2eb00) 00010000:00010000:3.0:1790710852.032015:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790710852.032018:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216b600/0xcbad34b281571021 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710852.032023:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216b600/0xcbad34b281571021 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710852.032053:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216a600/0xcbad34b281571013 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000447 expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710852.032066:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216a800/0xcbad34b281571028 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000447 expref: 11 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710852.032073:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c51c2c2ee00) 00010000:00010000:3.0:1790710852.032085:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1790710852.032088:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c520216a800, rc 0) 00000100:00100000:3.0:1790710852.032176:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c812d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+11:10267:x1877696158133120:12345-192.168.206.46@tcp:101:bash.0 Request processed in 638us (814us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710852.032191:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 39 00000100:00100000:3.0:1790710852.035002:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710852.035078:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158133376 00000100:00100000:1.0:1790710852.035087:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158133376 00000100:00100000:1.0:1790710852.035176:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 40 00000100:00100000:1.0:1790710852.035186:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c652c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+11:10267:x1877696158133376:12345-192.168.206.46@tcp:101:bash.0 00010000:00010000:1.0:1790710852.035205:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790710852.035223:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b28157102f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b05700044e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710852.035386:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571036 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710852.035400:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571036 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710852.035412:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571036 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710852.035599:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b28157103d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710852.035612:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b28157103d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710852.035632:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b28157103d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790710852.036308:0:5846:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:0.0:1790710852.036481:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031800/0xcbad34b281571044 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710852.036491:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031800/0xcbad34b281571044 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710852.036499:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031800/0xcbad34b281571044 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710852.036532:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571036 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710852.036539:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571036 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710852.036546:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571036 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710852.036552:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c6481000 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1790710852.036557:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571036 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710852.036565:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571036 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710852.036577:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c51c2c2ee00) 00010000:00010000:0.0:1790710852.036580:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790710852.036592:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571036 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710852.036598:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571036 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790710852.036610:0:5846:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000001626f460 reply state 00000000100bacf0 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b28157103d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710852.036619:0:5846:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1790710852.036648:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b28157102f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700044e expref: 14 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710852.036661:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031800/0xcbad34b281571044 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700044e expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710852.036668:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c51e4efb300) 00010000:00010000:0.0:1790710852.036670:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790710852.036673:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c0031800, rc 0) 00000100:00100000:0.0:1790710852.037246:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c652c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+14:10267:x1877696158133376:12345-192.168.206.46@tcp:101:bash.0 Request processed in 1561us (1751us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1790710852.037256:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 40 00010000:00010000:3.0:1790710852.040012:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b28157103d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710852.040027:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b28157103d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710852.040035:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b28157103d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710852.040041:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c0030000 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1790710852.040045:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b28157103d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710852.040052:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b28157103d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710852.040080:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c51e4efbd00) 00010000:00010000:3.0:1790710852.040084:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790710852.040089:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b28157103d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710852.040103:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b28157103d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710852.042195:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710852.042264:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158133504 00000100:00100000:0.0:1790710852.042274:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158133504 00000100:00100000:0.0:1790710852.042335:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 20 00000100:00100000:0.0:1790710852.042342:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c652ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2355:x1877696158133504:12345-192.168.206.46@tcp:8:bash.0 00010000:00080000:0.0:1790710852.042371:0:6698:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 0ec73bd1-726e-4dc0-8edd-807d3f973d65@192.168.206.46@tcp t0 exp 0000000000000000 cur 329 last 0 00000020:00000080:0.0:1790710852.042397:0:6698:0:(genops.c:1384:class_connect()) connect: client 0ec73bd1-726e-4dc0-8edd-807d3f973d65, cookie 0xcbad34b281571052 00002000:00100000:0.0:1790710852.042643:0:6698:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0ec73bd1-726e-4dc0-8edd-807d3f973d65/ffff9c51ca7d8000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790710852.042669:0:6698:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1790710852.042898:0:6698:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1790710852.042926:0:6698:0:(import.c:65:import_set_state_nolock()) ffff9c51ca7dd000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790710852.042995:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c652ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:2355:x1877696158133504:12345-192.168.206.46@tcp:8:bash.0 Request processed in 651us (809us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710852.043003:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 20 00000100:00100000:0.0:1790710852.045207:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710852.045927:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158133632 00000100:00100000:2.0:1790710852.045937:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158133632 00000100:00100000:2.0:1790710852.046006:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 21 00000100:00100000:2.0:1790710852.046015:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c812f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:0:x1877696158133632:12345-192.168.206.46@tcp:101:bash.0 00010000:00010000:2.0:1790710852.046044:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790710852.046066:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000688c06ff/0xcbad34b281571059 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b057000455 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790710852.046122:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790710852.046167:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=329s v=(0 0) 00010000:00010000:2.0:1790710852.046172:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790710852.046181:0:6697:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000688c06ff/0xcbad34b281571059 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000455 expref: 7 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710852.046201:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000688c06ff/0xcbad34b281571059 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000455 expref: 7 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710852.046214:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c8046200, rc 0) 00000100:00100000:2.0:1790710852.046374:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c812f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+7:0:x1877696158133632:12345-192.168.206.46@tcp:101:bash.0 Request processed in 359us (1296us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710852.046381:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 21 00000100:00080000:0.0:1790710852.048701:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790710852.051923:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710852.052010:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158133760 00000100:00100000:0.0:1790710852.052020:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158133760 00000100:00100000:0.0:1790710852.052067:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 22 00000100:00100000:0.0:1790710852.052075:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c652a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+7:10267:x1877696158133760:12345-192.168.206.46@tcp:101:bash.0 00010000:00010000:0.0:1790710852.052093:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790710852.052111:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008cdb18a6/0xcbad34b281571060 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b05700045c expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710852.052174:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000688c06ff/0xcbad34b281571059 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000455 expref: 8 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710852.052184:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790710852.052188:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790710852.052193:0:6698:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008cdb18a6/0xcbad34b281571060 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700045c expref: 8 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710852.052234:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000688c06ff/0xcbad34b281571059 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.46@tcp remote: 0x566877b057000455 expref: 8 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710852.052268:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000688c06ff/0xcbad34b281571059 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000455 expref: 8 pid: 6697 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710852.052283:0:6698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9ca1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6698:1877696177043328:192.168.206.46@tcp:104: 00000100:00100000:0.0:1790710852.052582:0:6698:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c8dc7000 going to sleep for 11 seconds 00000100:00100000:0.0:1790710852.056612:0:6698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9ca1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6698:1877696177043328:192.168.206.46@tcp:104: 00010000:00010000:0.0:1790710852.056646:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008cdb18a6/0xcbad34b281571060 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.46@tcp remote: 0x566877b05700045c expref: 8 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710852.056666:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c0030200, rc 0) 00000100:00100000:0.0:1790710852.056724:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c652a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+8:10267:x1877696158133760:12345-192.168.206.46@tcp:101:bash.0 Request processed in 4648us (4809us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710852.056733:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 22 00000100:00100000:3.0:1790710852.057643:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710852.060049:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158133888 00000100:00100000:0.0:1790710852.060065:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158133888 00010000:00010000:0.0:1790710852.060112:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000688c06ff/0xcbad34b281571059 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000455 expref: 8 pid: 6697 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710852.060198:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 35 00000100:00100000:0.0:1790710852.060208:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c652f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+8:2358:x1877696158133888:12345-192.168.206.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790710852.060223:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790710852.060253:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000688c06ff/0xcbad34b281571059 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000455 expref: 8 pid: 6697 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710852.060290:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000688c06ff/0xcbad34b281571059 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000455 expref: 8 pid: 6697 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710852.060324:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000688c06ff/0xcbad34b281571059 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000455 expref: 8 pid: 6697 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710852.060340:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790710852.060343:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790710852.060351:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008cdb18a6/0xcbad34b281571060 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.46@tcp remote: 0x566877b05700045c expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710852.060361:0:5830:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008cdb18a6/0xcbad34b281571060 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.46@tcp remote: 0x566877b05700045c expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710852.060397:0:5830:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000008cdb18a6/0xcbad34b281571060 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.46@tcp remote: 0x566877b05700045c expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710852.060423:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9ca1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5830:1877696177043456:192.168.206.46@tcp:105: 00000100:00100000:0.0:1790710852.060521:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c8dc7000 going to sleep for 11 seconds 00000100:00100000:1.0:1790710852.065163:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710852.066297:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158134144 00000100:00100000:3.0:1790710852.066307:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158134144 00000100:00100000:3.0:1790710852.066396:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 6 00000100:00100000:3.0:1790710852.066406:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c652aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+13:10267:x1877696158134144:12345-192.168.206.46@tcp:35:bash.0 00000100:00100000:3.0:1790710852.066730:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c652aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+14:10267:x1877696158134144:12345-192.168.206.46@tcp:35:bash.0 Request processed in 324us (1603us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1790710852.066738:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 6 00000100:00100000:0.0:1790710852.067510:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9ca1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5830:1877696177043456:192.168.206.46@tcp:105: 00010000:00010000:0.0:1790710852.067533:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790710852.067577:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c652f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+7:2358:x1877696158133888:12345-192.168.206.46@tcp:103:ldlm_bl.0 Request processed in 7369us (9937us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710852.067586:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 35 00010000:00010000:2.0:1790710852.105206:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790710852.132495:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710852.132582:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158134400 00000100:00100000:3.0:1790710852.132593:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158134400 00000100:00100000:3.0:1790710852.132648:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 41 00000100:00100000:3.0:1790710852.132658:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c6528000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+14:10277:x1877696158134400:12345-192.168.206.46@tcp:101:lfs.0 00010000:00010000:3.0:1790710852.132680:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790710852.132697:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216a600/0xcbad34b281571067 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b057000463 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790710852.132788:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1790710852.132904:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216a600/0xcbad34b281571067 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000463 expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710852.132918:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c51d8e33600) 00010000:00010000:3.0:1790710852.132922:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790710852.132927:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216a600/0xcbad34b281571067 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000463 expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710852.132941:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c520216a600, rc 0) 00000100:00100000:3.0:1790710852.133006:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c6528000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+15:10277:x1877696158134400:12345-192.168.206.46@tcp:101:lfs.0 Request processed in 349us (519us total) trans 4294967313 rc 301/301 00000100:00100000:3.0:1790710852.133013:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 41 00000100:00100000:2.0:1790710852.138516:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710852.138662:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158134656 00000100:00100000:3.0:1790710852.138685:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158134656 00000100:00100000:3.0:1790710852.138744:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 7 00000100:00100000:3.0:1790710852.138753:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4864000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+15:10277:x1877696158134656:12345-192.168.206.46@tcp:35:lfs.0 00000100:00100000:3.0:1790710852.139193:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4864000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+16:10277:x1877696158134656:12345-192.168.206.46@tcp:35:lfs.0 Request processed in 440us (683us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1790710852.139201:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 7 00000100:00100000:0.0:1790710852.214250:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710852.214368:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158134784 00000100:00100000:3.0:1790710852.214378:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158134784 00000100:00100000:3.0:1790710852.214435:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 42 00000100:00100000:3.0:1790710852.214445:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9ca1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+16:10283:x1877696158134784:12345-192.168.206.46@tcp:101:lfs.0 00010000:00010000:3.0:1790710852.214471:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790710852.214491:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216a600/0xcbad34b281571075 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b05700046a expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710852.214555:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216b600/0xcbad34b28157107c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710852.214569:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216b600/0xcbad34b28157107c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710852.214581:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216b600/0xcbad34b28157107c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790710852.214614:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1790710852.214617:0:5845:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790710852.214635:0:5845:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216b600/0xcbad34b28157107c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710852.214660:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216a600/0xcbad34b281571075 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700046a expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710852.214692:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216b600/0xcbad34b28157107c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700046a expref: 17 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710852.214701:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c51c2c2ee00) 00010000:00010000:3.0:1790710852.214704:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790710852.214707:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c520216b600, rc 0) 00000100:00100000:3.0:1790710852.214894:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9ca1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+17:10283:x1877696158134784:12345-192.168.206.46@tcp:101:lfs.0 Request processed in 449us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710852.214902:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 42 00000100:00100000:1.0:1790710852.221902:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710852.221985:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158135040 00000100:00100000:3.0:1790710852.221995:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158135040 00000100:00100000:3.0:1790710852.222049:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 43 00000100:00100000:3.0:1790710852.222059:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c6529c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+17:10283:x1877696158135040:12345-192.168.206.46@tcp:101:lfs.0 00010000:00010000:3.0:1790710852.222077:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790710852.222096:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216a600/0xcbad34b281571083 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b057000471 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710852.222221:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216be00/0xcbad34b28157108a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710852.222246:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216be00/0xcbad34b28157108a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710852.222256:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216be00/0xcbad34b28157108a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790710852.222267:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1790710852.222405:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216a600/0xcbad34b281571083 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000471 expref: 20 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710852.222423:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216be00/0xcbad34b28157108a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000471 expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710852.222431:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c51e4efb300) 00010000:00010000:3.0:1790710852.222435:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790710852.222438:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c520216be00, rc 0) 00000100:00100000:3.0:1790710852.222495:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c6529c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+19:10283:x1877696158135040:12345-192.168.206.46@tcp:101:lfs.0 Request processed in 436us (600us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1790710852.222506:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 43 00000100:00100000:2.0:1790710852.230762:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710852.230883:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710852.231018:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158135424 00000100:00100000:0.0:1790710852.231037:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158135424 00000100:00100000:0.0:1790710852.231105:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 44 00000100:00100000:0.0:1790710852.231114:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4864380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+19:10283:x1877696158135424:12345-192.168.206.46@tcp:101:lfs.0 00010000:00010000:0.0:1790710852.231168:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790710852.231189:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031600/0xcbad34b281571098 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b057000478 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710852.231296:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030c00/0xcbad34b28157109f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710852.231311:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030c00/0xcbad34b28157109f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710852.231321:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030c00/0xcbad34b28157109f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790710852.231333:0:5846:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1790710852.231452:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031600/0xcbad34b281571098 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000478 expref: 22 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710852.231471:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030c00/0xcbad34b28157109f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000478 expref: 21 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710852.231479:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c51e4efb300) 00010000:00010000:0.0:1790710852.231483:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1790710852.231486:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c0030c00, rc 0) 00000100:00100000:0.0:1790710852.231538:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4864380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+21:10283:x1877696158135424:12345-192.168.206.46@tcp:101:lfs.0 Request processed in 424us (654us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1790710852.231561:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 44 00000100:00100000:1.0:1790710852.232816:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158135168 00000100:00100000:1.0:1790710852.232826:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158135168 00000100:00100000:1.0:1790710852.233570:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 2 00000100:00100000:1.0:1790710852.233583:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4866680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+21:2357:x1877696158135168:12345-192.168.206.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790710852.233597:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790710852.233617:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216be00/0xcbad34b28157108a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000471 expref: 21 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710852.233636:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c51e4efb300) 00010000:00010000:1.0:1790710852.233640:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790710852.233695:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4866680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+20:2357:x1877696158135168:12345-192.168.206.46@tcp:103:ldlm_bl.0 Request processed in 115us (2940us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710852.233702:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 2 00000100:00100000:2.0:1790710852.245462:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710852.245749:0:6696:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158135552 00000100:00100000:3.0:1790710852.245759:0:6696:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158135552 00000100:00100000:3.0:1790710852.245857:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 23 00000100:00100000:3.0:1790710852.245878:0:6696:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4865f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+7:2358:x1877696158135552:12345-192.168.206.46@tcp:1:lfs.0 00010000:00010000:3.0:1790710852.245926:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f7929b6/0xcbad34b2815710ad lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710852.245946:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008cdb18a6/0xcbad34b281571060 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.46@tcp remote: 0x566877b05700045c expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710852.245955:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790710852.245959:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790710852.245964:0:6696:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f7929b6/0xcbad34b2815710ad lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710852.245997:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008cdb18a6/0xcbad34b281571060 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.46@tcp remote: 0x566877b05700045c expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710852.246027:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008cdb18a6/0xcbad34b281571060 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.46@tcp remote: 0x566877b05700045c expref: 7 pid: 6698 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710852.246042:0:6696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c652e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6696:1877696177043584:192.168.206.46@tcp:104: 00000100:00100000:3.0:1790710852.246205:0:6696:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51d8a96180 going to sleep for 11 seconds 00000100:00100000:3.0:1790710852.251566:0:6696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c652e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6696:1877696177043584:192.168.206.46@tcp:104: 00010000:00010000:3.0:1790710852.251598:0:6696:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000f7929b6/0xcbad34b2815710ad lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710852.257216:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710852.257388:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158135680 00000100:00100000:1.0:1790710852.257411:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158135680 00002000:00100000:1.0:1790710852.257455:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9c51f9577b80 x1877696158135680/t0(0) o4->0ec73bd1-726e-4dc0-8edd-807d3f973d65@192.168.206.46@tcp:353/0 lens 504/0 e 0 to 0 dl 1790710863 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790710852.257468:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c51f9577b80 with x1877696158135680 ext(0->12) 00010000:00010000:1.0:1790710852.257765:0:6701:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000008cdb18a6/0xcbad34b281571060 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.46@tcp remote: 0x566877b05700045c expref: 8 pid: 6698 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710852.257783:0:6701:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000008cdb18a6/0xcbad34b281571060 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.46@tcp remote: 0x566877b05700045c expref: 8 pid: 6698 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790710852.257792:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9c51f9577b80 00000100:00100000:1.0:1790710852.257879:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 0 00000100:00100000:1.0:1790710852.257890:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9577b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+8:2358:x1877696158135680:12345-192.168.206.46@tcp:4:lfs.0 00000001:00100000:1.0:1790710852.285739:0:6720:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0ec73bd1-726e-4dc0-8edd-807d3f973d65 00000001:00080000:3.0:1790710852.321478:0:6720:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:2.0:1790710852.321683:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9577b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+7:2358:x1877696158135680:12345-192.168.206.46@tcp:4:lfs.0 Request processed in 63788us (64470us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1790710852.321702:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 0 00002000:00100000:2.0:1790710852.321723:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9c51f9577b80 x1877696158135680/t4294967299(0) o4->0ec73bd1-726e-4dc0-8edd-807d3f973d65@192.168.206.46@tcp:353/0 lens 504/448 e 0 to 0 dl 1790710863 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790710852.321734:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c51f9577b80 with x1877696158135680 ext(0->12) 00010000:00010000:2.0:1790710852.321744:0:6701:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000008cdb18a6/0xcbad34b281571060 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.46@tcp remote: 0x566877b05700045c expref: 7 pid: 6698 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710852.321762:0:6701:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000008cdb18a6/0xcbad34b281571060 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.46@tcp remote: 0x566877b05700045c expref: 7 pid: 6698 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790710852.321770:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9c51f9577b80 00000100:00100000:0.0:1790710852.324737:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710852.324831:0:8449:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158135808 00000100:00100000:1.0:1790710852.324841:0:8449:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158135808 00010000:00010000:1.0:1790710852.324941:0:8449:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008cdb18a6/0xcbad34b281571060 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.46@tcp remote: 0x566877b05700045c expref: 7 pid: 6698 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710852.325018:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 36 00000100:00100000:1.0:1790710852.325028:0:8449:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9ca0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+7:2358:x1877696158135808:12345-192.168.206.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790710852.325043:0:8449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1790710852.325062:0:8449:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1790710852.325065:0:8449:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1790710851 00002000:00010000:1.0:1790710852.325067:0:8449:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1790710851 00002000:00010000:1.0:1790710852.325069:0:8449:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1790710851 00002000:00010000:1.0:1790710852.325208:0:8449:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:1.0:1790710852.325216:0:8449:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008cdb18a6/0xcbad34b281571060 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.46@tcp remote: 0x566877b05700045c expref: 7 pid: 6698 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710852.325239:0:8449:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008cdb18a6/0xcbad34b281571060 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.46@tcp remote: 0x566877b05700045c expref: 7 pid: 6698 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710852.325264:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008cdb18a6/0xcbad34b281571060 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.46@tcp remote: 0x566877b05700045c expref: 7 pid: 6698 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710852.325282:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790710852.325286:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790710852.325292:0:8449:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000f7929b6/0xcbad34b2815710ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710852.325301:0:8449:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f7929b6/0xcbad34b2815710ad lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710852.325339:0:8449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790710852.325429:0:8449:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9ca0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:2358:x1877696158135808:12345-192.168.206.46@tcp:103:ldlm_bl.0 Request processed in 402us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710852.325437:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 36 00010000:00010000:3.0:1790710852.325490:0:6696:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000f7929b6/0xcbad34b2815710ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710852.325500:0:6696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000f7929b6/0xcbad34b2815710ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710852.325524:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f7929b6/0xcbad34b2815710ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710852.325532:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000f7929b6/0xcbad34b2815710ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710852.325540:0:6696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000f7929b6/0xcbad34b2815710ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710852.325560:0:6696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c520216a600 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:3.0:1790710852.325564:0:6696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000f7929b6/0xcbad34b2815710ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710852.325573:0:6696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000f7929b6/0xcbad34b2815710ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710852.325586:0:6696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000f7929b6/0xcbad34b2815710ad lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710852.325593:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000f7929b6/0xcbad34b2815710ad lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710852.325642:0:6696:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4865f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+5:2358:x1877696158135552:12345-192.168.206.46@tcp:1:lfs.0 Request processed in 79776us (80199us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710852.325651:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 23 00000100:00100000:1.0:1790710852.328410:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710852.328613:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158136064 00000100:00100000:0.0:1790710852.328622:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158136064 00000100:00100000:0.0:1790710852.328669:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 8 00000100:00100000:0.0:1790710852.328678:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c6528700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+20:10283:x1877696158136064:12345-192.168.206.46@tcp:35:lfs.0 00000004:00010000:0.0:1790710852.328738:0:5849:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030c00/0xcbad34b28157109f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000478 expref: 20 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790710852.329005:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:0.0:1790710852.329063:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:0.0:1790710852.329691:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:0.0:1790710852.329740:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031600/0xcbad34b2815710b4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710852.329755:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031800/0xcbad34b281571044 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700044e expref: 24 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710852.329764:0:5849:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031600/0xcbad34b2815710b4 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710852.329796:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031800/0xcbad34b281571044 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.46@tcp remote: 0x566877b05700044e expref: 24 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710852.329810:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031800/0xcbad34b281571044 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.46@tcp remote: 0x566877b05700044e expref: 24 pid: 5846 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710852.329823:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9ca1c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5849:1877696177043712:192.168.206.46@tcp:104: 00000100:00100000:0.0:1790710852.330025:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c8dc70c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790710852.334756:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9ca1c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5849:1877696177043712:192.168.206.46@tcp:104: 00010000:00010000:0.0:1790710852.334788:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031600/0xcbad34b2815710b4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710852.335483:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710852.335666:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158136192 00000100:00100000:2.0:1790710852.335674:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158136192 00010000:00010000:2.0:1790710852.335709:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031800/0xcbad34b281571044 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.46@tcp remote: 0x566877b05700044e expref: 25 pid: 5846 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710852.335787:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 37 00000100:00100000:2.0:1790710852.335796:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c6529f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+25:2359:x1877696158136192:12345-192.168.206.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790710852.335810:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790710852.335817:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031800/0xcbad34b281571044 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.46@tcp remote: 0x566877b05700044e expref: 25 pid: 5846 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710852.335829:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031800/0xcbad34b281571044 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.46@tcp remote: 0x566877b05700044e expref: 25 pid: 5846 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710852.335849:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031800/0xcbad34b281571044 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.46@tcp remote: 0x566877b05700044e expref: 25 pid: 5846 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710852.335883:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c51e4efb300) 00010000:00010000:2.0:1790710852.335887:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031600/0xcbad34b2815710b4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710852.335897:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031600/0xcbad34b2815710b4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710852.335905:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031600/0xcbad34b2815710b4 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710852.335940:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790710852.336011:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c6529f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+24:2359:x1877696158136192:12345-192.168.206.46@tcp:103:ldlm_bl.0 Request processed in 215us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710852.336018:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 37 00010000:00010000:0.0:1790710852.336378:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031600/0xcbad34b2815710b4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710852.336388:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031600/0xcbad34b2815710b4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790710852.336510:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1790710852.336706:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:0.0:1790710852.336808:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9ca1c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5849:1877696177043840:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1790710852.336856:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710852.336884:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c8dc7900 going to sleep for 11 seconds 00000100:00100000:3.0:1790710852.336990:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177043840 00000100:00100000:3.0:1790710852.336996:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177043840 00000100:00100000:3.0:1790710852.337047:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790710852.337055:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9ca0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5849:x1877696177043840:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1790710852.337122:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9ca0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5849:x1877696177043840:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 67us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710852.337155:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1790710852.337267:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790710852.337297:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9ca1c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5849:1877696177043840:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1790710852.337886:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:0.0:1790710852.337944:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9ca1c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5849:1877696177043968:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1790710852.338030:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710852.338054:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c8dc70c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790710852.338076:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177043968 00000100:00100000:0.0:1790710852.338080:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177043968 00000100:00100000:0.0:1790710852.338104:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790710852.338111:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9ca3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5849:x1877696177043968:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1790710852.338339:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9ca3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5849:x1877696177043968:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 228us (308us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1790710852.338677:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790710852.338720:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9ca1c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5849:1877696177043968:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1790710852.338767:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:0.0:1790710852.338804:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031600/0xcbad34b2815710b4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710852.339566:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031600/0xcbad34b2815710b4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710852.339575:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031600/0xcbad34b2815710b4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710852.339580:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c0031600 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1790710852.339585:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031600/0xcbad34b2815710b4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710852.339593:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031600/0xcbad34b2815710b4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710852.339608:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c51e4efb300) 00010000:00010000:0.0:1790710852.339611:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1790710852.339615:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031600/0xcbad34b2815710b4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710852.339621:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031600/0xcbad34b2815710b4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790710852.339977:0:5849:0:(mdd_object.c:4180:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1790710852.340737:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1790710852.340752:0:5849:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 329677623757ns, next at 330677620858ns, rc = 0 00000001:00080000:0.0:1790710852.340771:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:0.0:1790710852.340944:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c51e4efb300) 00010000:00010000:0.0:1790710852.340949:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1790710852.340957:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030c00/0xcbad34b28157109f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000478 expref: 28 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710852.341121:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c6528700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+27:10283:x1877696158136064:12345-192.168.206.46@tcp:35:lfs.0 Request processed in 12442us (12717us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1790710852.341154:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 8 00000020:00080000:0.0:1790710852.341159:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1790710852.345590:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710852.346471:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158136320 00000100:00100000:3.0:1790710852.346482:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158136320 00000100:00100000:0.0:1790710852.346660:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 45 00000100:00100000:0.0:1790710852.346671:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c6528e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+27:10283:x1877696158136320:12345-192.168.206.46@tcp:101:lfs.0 00010000:00010000:0.0:1790710852.346695:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790710852.346716:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031a00/0xcbad34b2815710bb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b05700047f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710852.346782:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031a00/0xcbad34b2815710bb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700047f expref: 28 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710852.346797:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031a00/0xcbad34b2815710bb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700047f expref: 28 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710852.346830:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c51e4efb600) 00010000:00010000:0.0:1790710852.346833:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790710852.346836:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c0031a00, rc 0) 00000100:00100000:0.0:1790710852.347012:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c6528e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+28:10283:x1877696158136320:12345-192.168.206.46@tcp:101:lfs.0 Request processed in 341us (1428us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710852.347028:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 45 00000100:00100000:2.0:1790710852.350929:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710852.351015:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158136576 00000100:00100000:3.0:1790710852.351025:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158136576 00000100:00100000:3.0:1790710852.351094:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 9 00000100:00100000:3.0:1790710852.351104:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d6260850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+28:10283:x1877696158136576:12345-192.168.206.46@tcp:35:lfs.0 00000100:00100000:3.0:1790710852.351378:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d6260850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+29:10283:x1877696158136576:12345-192.168.206.46@tcp:35:lfs.0 Request processed in 274us (456us total) trans 4294967326 rc 0/0 00000100:00100000:3.0:1790710852.351386:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 9 00000001:00080000:1.0:1790710852.427121:0:5867:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967325 is committed 00000004:00080000:1.0:1790710852.427150:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:0.0:1790710852.427576:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000020:00080000:1.0:1790710852.427696:0:5867:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c51c8dc7900 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1790710852.427701:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c51e03adf00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c51c8dc7c00 00000020:00080000:1.0:1790710852.427704:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c51e03ad600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c51ff16a000 00000001:00080000:1.0:1790710852.427741:0:5867:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967326 is committed 00000020:00080000:3.0:1790710852.427800:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:3.0:1790710852.427910:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1790710852.427982:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9575500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177044096:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1790710852.428045:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710852.428487:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177044096 00000100:00100000:2.0:1790710852.428494:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177044096 00000100:00100000:2.0:1790710852.428572:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790710852.428581:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9ca2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3311:x1877696177044096:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1790710852.428607:0:6698:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:2.0:1790710852.428637:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6abc1443, atime: 0x6abc1443, ctime: 0x6abc1443, blocks: 0xb 00010000:00010000:2.0:1790710852.428645:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000688c06ff/0xcbad34b2815710c2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710852.428662:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=329s v=(0 0) 00010000:00010000:2.0:1790710852.428666:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790710852.428673:0:6698:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000688c06ff/0xcbad34b2815710c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710852.428696:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000688c06ff/0xcbad34b2815710c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710852.428707:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000688c06ff/0xcbad34b2815710c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710852.428715:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000688c06ff/0xcbad34b2815710c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710852.428738:0:6698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1790710852.429378:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c51f9575500/2, rc 0, transno 4294967301 00000100:00100000:3.0:1790710852.429386:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9575500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177044096:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1790710852.429591:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9ca2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3311:x1877696177044096:12345-0@lo:6:osp-syn-0-0.0 Request processed in 667us (1202us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1790710852.429600:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1790710852.429657:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790710852.429664:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000688c06ff/0xcbad34b2815710c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710852.429674:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c8046200 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:1.0:1790710852.429678:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000688c06ff/0xcbad34b2815710c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710852.429688:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000688c06ff/0xcbad34b2815710c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710852.429706:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000688c06ff/0xcbad34b2815710c2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710852.429713:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000688c06ff/0xcbad34b2815710c2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710852.429732:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790710852.429734:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790710852.429736:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790710852.447712:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710852.447825:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158136832 00000100:00100000:0.0:1790710852.447835:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158136832 00000100:00100000:0.0:1790710852.447899:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 46 00000100:00100000:0.0:1790710852.447909:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c652e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+11:10293:x1877696158136832:12345-192.168.206.46@tcp:101:lfs.0 00010000:00010000:0.0:1790710852.447933:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790710852.447952:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030c00/0xcbad34b2815710c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b057000486 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790710852.448044:0:5846:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1790710852.448309:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030c00/0xcbad34b2815710c9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000486 expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710852.448323:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c51d8e33600) 00010000:00010000:0.0:1790710852.448326:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790710852.448331:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030c00/0xcbad34b2815710c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000486 expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710852.448343:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c0030c00, rc 0) 00000100:00100000:2.0:1790710852.448808:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c652e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+12:10293:x1877696158136832:12345-192.168.206.46@tcp:101:lfs.0 Request processed in 898us (1103us total) trans 4294967327 rc 301/301 00000100:00100000:2.0:1790710852.448816:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 46 00000100:00100000:2.0:1790710852.459646:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710852.462859:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158136960 00000100:00100000:1.0:1790710852.462876:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158136960 00000100:00100000:1.0:1790710852.462936:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 47 00000100:00100000:1.0:1790710852.463497:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c75de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+12:10293:x1877696158136960:12345-192.168.206.46@tcp:34:lfs.0 00010000:00010000:2.0:1790710852.464091:0:8060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b2815710d7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710852.464457:0:8060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b2815710d7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710852.464470:0:8060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b2815710d7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710852.464487:0:8060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b2815710de lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710852.464502:0:8060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b2815710de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710852.464507:0:8060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b2815710de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710852.464819:0:8060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046200/0xcbad34b2815710e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710852.464829:0:8060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046200/0xcbad34b2815710e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710852.464839:0:8060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046200/0xcbad34b2815710e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790710852.464894:0:8060:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046200/0xcbad34b2815710e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710852.464908:0:8060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b2815710d7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710852.464916:0:8060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b2815710d7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710852.464926:0:8060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b2815710d7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710852.464933:0:8060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c8047800 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1790710852.464936:0:8060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b2815710d7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710852.464947:0:8060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b2815710d7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710852.464969:0:8060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c51c2c2ee00) 00010000:00010000:2.0:1790710852.464972:0:8060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790710852.464977:0:8060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b2815710d7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710852.464983:0:8060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b2815710d7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710852.464998:0:8060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b2815710de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710852.465005:0:8060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b2815710de lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710852.465011:0:8060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b2815710de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710852.465020:0:8060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c8047a00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1790710852.465023:0:8060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b2815710de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710852.465029:0:8060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b2815710de lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710852.465036:0:8060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c51cca25a00) 00010000:00010000:2.0:1790710852.465038:0:8060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790710852.465044:0:8060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b2815710de lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710852.465050:0:8060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b2815710de lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710852.465080:0:8060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046200/0xcbad34b2815710e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710852.465087:0:8060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046200/0xcbad34b2815710e5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710852.465096:0:8060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046200/0xcbad34b2815710e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710852.465102:0:8060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c8046200 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1790710852.465105:0:8060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046200/0xcbad34b2815710e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710852.465114:0:8060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046200/0xcbad34b2815710e5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710852.465121:0:8060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c51e4efb600) 00010000:00010000:2.0:1790710852.465124:0:8060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790710852.465172:0:8060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046200/0xcbad34b2815710e5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710852.465179:0:8060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046200/0xcbad34b2815710e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710852.465284:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c75de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+12:10293:x1877696158136960:12345-192.168.206.46@tcp:34:lfs.0 Request processed in 2324us (5646us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710852.465294:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 47 00000100:00100000:2.0:1790710852.468685:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710852.468764:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158137216 00000100:00100000:3.0:1790710852.468774:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158137216 00000100:00100000:3.0:1790710852.468889:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 10 00000100:00100000:3.0:1790710852.468900:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c75dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+12:10293:x1877696158137216:12345-192.168.206.46@tcp:35:lfs.0 00000100:00100000:3.0:1790710852.470048:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c75dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+13:10293:x1877696158137216:12345-192.168.206.46@tcp:35:lfs.0 Request processed in 1144us (1365us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1790710852.470060:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 10 00000100:00100000:3.0:1790710852.527501:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710852.527669:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158137472 00000100:00100000:0.0:1790710852.527679:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158137472 00000100:00100000:0.0:1790710852.527750:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 48 00000100:00100000:0.0:1790710852.527760:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c652f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+13:10296:x1877696158137472:12345-192.168.206.46@tcp:101:lfs.0 00010000:00010000:0.0:1790710852.527797:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790710852.527816:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030c00/0xcbad34b2815710ec lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b05700048d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710852.527887:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031600/0xcbad34b2815710f3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710852.527902:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031600/0xcbad34b2815710f3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710852.527913:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031600/0xcbad34b2815710f3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710852.527928:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031800/0xcbad34b2815710fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710852.527936:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031800/0xcbad34b2815710fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710852.527942:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031800/0xcbad34b2815710fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710852.528453:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b281571101 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710852.528464:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b281571101 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710852.528471:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b281571101 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790710852.528481:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1790710852.528569:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031600/0xcbad34b2815710f3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710852.528578:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031600/0xcbad34b2815710f3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710852.528585:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031600/0xcbad34b2815710f3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710852.528590:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c0031600 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1790710852.528594:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031600/0xcbad34b2815710f3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710852.528601:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031600/0xcbad34b2815710f3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710852.528612:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c51c2c2ee00) 00010000:00010000:1.0:1790710852.528614:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790710852.528618:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031600/0xcbad34b2815710f3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710852.528635:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031600/0xcbad34b2815710f3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710852.528648:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031800/0xcbad34b2815710fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710852.528653:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031800/0xcbad34b2815710fa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710852.528658:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031800/0xcbad34b2815710fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710852.528663:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c0031800 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1790710852.528666:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031800/0xcbad34b2815710fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710852.528673:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031800/0xcbad34b2815710fa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710852.528681:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c51e4efb300) 00010000:00010000:1.0:1790710852.528684:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790710852.529491:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031800/0xcbad34b2815710fa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710852.529503:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031800/0xcbad34b2815710fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710852.529558:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030c00/0xcbad34b2815710ec lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700048d expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710852.529572:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b281571101 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700048d expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710852.529589:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c51e4efb600) 00010000:00010000:1.0:1790710852.529592:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790710852.529595:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c6481c00, rc 0) 00000100:00100000:1.0:1790710852.529664:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c652f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+15:10296:x1877696158137472:12345-192.168.206.46@tcp:101:lfs.0 Request processed in 1905us (2172us total) trans 4294967329 rc 0/0 00000100:00100000:1.0:1790710852.529673:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 48 00000100:00100000:2.0:1790710852.539833:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710852.540090:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158137600 00000100:00100000:0.0:1790710852.540100:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158137600 00000100:00100000:0.0:1790710852.540171:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 49 00000100:00100000:0.0:1790710852.540182:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c75df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+15:10296:x1877696158137600:12345-192.168.206.46@tcp:54:lfs.0 00010000:00010000:0.0:1790710852.540254:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030200/0xcbad34b28157110f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710852.540272:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030200/0xcbad34b28157110f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710852.540300:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030200/0xcbad34b28157110f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710852.540326:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030200/0xcbad34b28157110f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710852.540334:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030200/0xcbad34b28157110f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710852.540340:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030200/0xcbad34b28157110f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710852.540345:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c0030200 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1790710852.540349:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030200/0xcbad34b28157110f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710852.540367:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030200/0xcbad34b28157110f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710852.540378:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c51e4efb600) 00010000:00010000:0.0:1790710852.540381:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790710852.540385:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030200/0xcbad34b28157110f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710852.540391:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030200/0xcbad34b28157110f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710852.540463:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c75df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+15:10296:x1877696158137600:12345-192.168.206.46@tcp:54:lfs.0 Request processed in 283us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710852.540470:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 49 00000100:00100000:3.0:1790710852.548116:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710852.548398:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158137856 00000100:00100000:1.0:1790710852.548408:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158137856 00000100:00100000:1.0:1790710852.548462:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 11 00000100:00100000:1.0:1790710852.548471:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c652e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+15:10296:x1877696158137856:12345-192.168.206.46@tcp:35:lfs.0 00000100:00100000:1.0:1790710852.548737:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c652e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+16:10296:x1877696158137856:12345-192.168.206.46@tcp:35:lfs.0 Request processed in 257us (620us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1790710852.548746:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 11 00000100:00100000:3.0:1790710852.891677:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710852.891791:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158138112 00000100:00100000:2.0:1790710852.891814:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158138112 00000100:00100000:2.0:1790710852.891880:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 50 00000100:00100000:2.0:1790710852.891890:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c652ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+16:10327:x1877696158138112:12345-192.168.206.46@tcp:101:cat.0 00010000:00010000:2.0:1790710852.891915:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790710852.891936:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b281571116 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b057000494 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710852.892035:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b28157111d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710852.892051:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b28157111d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710852.892065:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b28157111d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790710852.892089:0:5846:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1790710852.892460:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b281571116 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000494 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710852.892480:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b28157111d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000494 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710852.892490:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c51e4efb600) 00010000:00010000:2.0:1790710852.892493:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790710852.892496:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c8046e00, rc 0) 00000100:00100000:2.0:1790710852.892559:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c652ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+18:10327:x1877696158138112:12345-192.168.206.46@tcp:101:cat.0 Request processed in 671us (890us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1790710852.892568:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 50 00000100:00100000:2.0:1790710852.900064:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710852.900125:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710852.900325:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158138368 00000100:00100000:1.0:1790710852.900334:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158138368 00000100:00100000:1.0:1790710852.900387:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 12 00000100:00100000:1.0:1790710852.900397:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c75dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+18:10327:x1877696158138368:12345-192.168.206.46@tcp:35:cat.0 00000100:00100000:1.0:1790710852.900713:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c75dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+19:10327:x1877696158138368:12345-192.168.206.46@tcp:35:cat.0 Request processed in 317us (656us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1790710852.900722:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 12 00000100:00100000:0.0:1790710852.901012:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158138496 00000100:00100000:0.0:1790710852.901029:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158138496 00000100:00100000:0.0:1790710852.901087:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 3 00000100:00100000:0.0:1790710852.901096:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c7cdc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+19:2359:x1877696158138496:12345-192.168.206.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790710852.901108:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790710852.901159:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b28157111d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000494 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710852.901179:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c51e4efb600) 00010000:00010000:0.0:1790710852.901183:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790710852.901208:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c7cdc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+18:2359:x1877696158138496:12345-192.168.206.46@tcp:103:ldlm_bl.0 Request processed in 113us (1083us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710852.901215:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 3 00000100:00100000:3.0:1790710852.985886:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710852.988201:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158138752 00000100:00100000:0.0:1790710852.988215:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158138752 00000100:00100000:0.0:1790710852.988364:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 51 00000100:00100000:0.0:1790710852.988376:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c652c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+18:10333:x1877696158138752:12345-192.168.206.46@tcp:101:dd.0 00010000:00010000:0.0:1790710852.988400:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790710852.989991:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1790710852.990024:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216b600/0xcbad34b28157107c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700046a expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710852.990044:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c51c2c2ee00) 00010000:00010000:0.0:1790710852.990049:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790710852.990064:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030200/0xcbad34b28157112b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b05700049b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710852.990201:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281571132 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710852.990241:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b281571101 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700048d expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710852.990249:0:5847:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281571132 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710852.990282:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b281571101 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.46@tcp remote: 0x566877b05700048d expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710852.990298:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b281571101 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.46@tcp remote: 0x566877b05700048d expref: 18 pid: 5845 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710852.990311:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9ca0380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1877696177044224:192.168.206.46@tcp:104: 00000100:00100000:0.0:1790710852.990540:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c8dc7a80 going to sleep for 11 seconds 00000100:00100000:0.0:1790710852.995271:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9ca0380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1877696177044224:192.168.206.46@tcp:104: 00010000:00010000:0.0:1790710852.995302:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281571132 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710852.997851:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710852.998013:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158138880 00000100:00100000:1.0:1790710852.998023:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158138880 00010000:00010000:1.0:1790710852.998064:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b281571101 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.46@tcp remote: 0x566877b05700048d expref: 19 pid: 5845 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710852.998167:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 38 00000100:00100000:1.0:1790710852.998177:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c652dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+19:2359:x1877696158138880:12345-192.168.206.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790710852.998192:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790710852.998199:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b281571101 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.46@tcp remote: 0x566877b05700048d expref: 19 pid: 5845 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710852.998211:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b281571101 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.46@tcp remote: 0x566877b05700048d expref: 19 pid: 5845 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710852.998243:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b281571101 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.46@tcp remote: 0x566877b05700048d expref: 19 pid: 5845 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710852.998259:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c51e4efb600) 00010000:00010000:1.0:1790710852.998263:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281571132 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710852.998273:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281571132 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710852.998280:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281571132 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710852.998369:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790710852.998642:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c652dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+18:2359:x1877696158138880:12345-192.168.206.46@tcp:103:ldlm_bl.0 Request processed in 442us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710852.998651:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 38 00010000:00010000:0.0:1790710853.002112:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281571132 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.002142:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281571132 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790710853.002164:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1790710853.002334:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030200/0xcbad34b28157112b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700049b expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.002380:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281571132 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700049b expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.002389:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c51e4efb600) 00010000:00010000:0.0:1790710853.002392:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790710853.002395:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c0030000, rc 0) 00000100:00100000:0.0:1790710853.002580:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c652c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+18:10333:x1877696158138752:12345-192.168.206.46@tcp:101:dd.0 Request processed in 14206us (16703us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1790710853.002589:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 51 00000100:00100000:3.0:1790710853.007747:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710853.007857:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158139136 00000100:00100000:1.0:1790710853.007880:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158139136 00000100:00100000:1.0:1790710853.007953:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 52 00000100:00100000:1.0:1790710853.007964:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c652c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+18:10333:x1877696158139136:12345-192.168.206.46@tcp:36:dd.0 00010000:00010000:1.0:1790710853.008273:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b281571140 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710853.008291:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b281571140 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710853.008301:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b281571140 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790710853.008352:0:5845:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:1.0:1790710853.008375:0:5845:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000baea33b6 reply state 00000000d71af124 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b281571140 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710853.008384:0:5845:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00080000:0.0:1790710853.008508:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790710853.011903:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c652c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+21:10333:x1877696158139136:12345-192.168.206.46@tcp:36:dd.0 Request processed in 3931us (4154us total) trans 4294967335 rc 0/0 00000100:00100000:1.0:1790710853.011914:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 52 00000020:00080000:1.0:1790710853.011920:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1790710853.020977:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b281571140 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.020994:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b281571140 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.021003:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b281571140 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.021008:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c6481c00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1790710853.021013:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b281571140 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.021020:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b281571140 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.021035:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c51e4efb600) 00010000:00010000:0.0:1790710853.021038:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790710853.021056:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b281571140 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.021063:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b281571140 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710853.127351:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790710853.318032:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710853.318446:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158139264 00000100:00100000:2.0:1790710853.318456:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158139264 00000100:00100000:2.0:1790710853.318520:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 53 00000100:00100000:2.0:1790710853.318530:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c652df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+20:10347:x1877696158139264:12345-192.168.206.46@tcp:101:stat.0 00010000:00010000:2.0:1790710853.318554:0:8060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790710853.318574:0:8060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b281571147 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b0570004a2 expref: -99 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710853.318636:0:8060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b28157114e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710853.318650:0:8060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b28157114e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710853.318659:0:8060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b28157114e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710853.318673:0:8060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b281571155 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710853.318679:0:8060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b281571155 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710853.318685:0:8060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b281571155 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710853.318967:0:8060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b28157115c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710853.318990:0:8060:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281571132 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700049b expref: 21 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710853.318998:0:8060:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b28157115c lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710853.319032:0:8060:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281571132 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.46@tcp remote: 0x566877b05700049b expref: 21 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710853.319046:0:8060:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281571132 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.46@tcp remote: 0x566877b05700049b expref: 21 pid: 5847 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710853.319059:0:8060:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d61500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8060:1877696177044352:192.168.206.46@tcp:104: 00000100:00100000:2.0:1790710853.319209:0:8060:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f979ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1790710853.322620:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710853.322782:0:8060:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d61500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8060:1877696177044352:192.168.206.46@tcp:104: 00010000:00010000:0.0:1790710853.322809:0:8060:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b28157115c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710853.323040:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158139520 00000100:00100000:1.0:1790710853.323047:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158139520 00000100:00100000:1.0:1790710853.323183:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 13 00000100:00100000:1.0:1790710853.323193:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f3e74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+22:5593:x1877696158139520:12345-192.168.206.46@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1790710853.323529:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f3e74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+23:5593:x1877696158139520:12345-192.168.206.46@tcp:35:ldlm_bl.0 Request processed in 336us (916us total) trans 4294967336 rc 0/0 00000100:00100000:1.0:1790710853.323537:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 13 00000100:00100000:3.0:1790710853.328562:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710853.328666:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158139648 00000100:00100000:0.0:1790710853.328676:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158139648 00010000:00010000:0.0:1790710853.328722:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281571132 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.46@tcp remote: 0x566877b05700049b expref: 23 pid: 5847 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710853.328762:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 39 00000100:00100000:0.0:1790710853.328772:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c652ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+23:2359:x1877696158139648:12345-192.168.206.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790710853.328787:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790710853.328795:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281571132 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.46@tcp remote: 0x566877b05700049b expref: 23 pid: 5847 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.328808:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281571132 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.46@tcp remote: 0x566877b05700049b expref: 23 pid: 5847 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.328830:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281571132 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.46@tcp remote: 0x566877b05700049b expref: 23 pid: 5847 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.328860:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c51e4efb600) 00010000:00010000:0.0:1790710853.328865:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b28157115c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.328890:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b28157115c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.328898:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b28157115c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.328931:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790710853.328991:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c652ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+22:2359:x1877696158139648:12345-192.168.206.46@tcp:103:ldlm_bl.0 Request processed in 219us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710853.328999:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 39 00010000:00010000:2.0:1790710853.329188:0:8060:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b28157115c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710853.329197:0:8060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b28157115c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790710853.329250:0:8060:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1790710853.329255:0:8060:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790710853.329296:0:8060:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b28157115c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710853.329309:0:8060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b28157115c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710853.329329:0:8060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b28157114e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710853.329336:0:8060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b28157114e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710853.329343:0:8060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b28157114e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710853.329348:0:8060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c8046800 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1790710853.329353:0:8060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b28157114e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710853.329360:0:8060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b28157114e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710853.329369:0:8060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c51c2c2ee00) 00010000:00010000:2.0:1790710853.329372:0:8060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790710853.329376:0:8060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b28157114e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710853.329382:0:8060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b28157114e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710853.329395:0:8060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b281571155 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710853.329402:0:8060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b281571155 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710853.329408:0:8060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b281571155 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710853.329420:0:8060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c8046e00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1790710853.329423:0:8060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b281571155 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710853.329429:0:8060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b281571155 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710853.329437:0:8060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c51cca25a00) 00010000:00010000:2.0:1790710853.329439:0:8060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790710853.329442:0:8060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b281571155 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710853.329447:0:8060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b281571155 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710853.329483:0:8060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b281571147 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570004a2 expref: 22 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710853.329497:0:8060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b28157115c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570004a2 expref: 21 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710853.329504:0:8060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c51e4efb600) 00010000:00010000:2.0:1790710853.329507:0:8060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790710853.329509:0:8060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c8047a00, rc 0) 00000100:00100000:2.0:1790710853.329543:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c652df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+21:10347:x1877696158139264:12345-192.168.206.46@tcp:101:stat.0 Request processed in 11009us (11514us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710853.329551:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 53 00000100:00100000:2.0:1790710853.399113:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710853.399285:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158139904 00000100:00100000:0.0:1790710853.399295:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158139904 00000100:00100000:0.0:1790710853.399363:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 54 00000100:00100000:0.0:1790710853.399373:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f3e77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+21:10353:x1877696158139904:12345-192.168.206.46@tcp:36:truncate.0 00010000:00010000:0.0:1790710853.399424:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790710853.399448:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b28157115c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570004a2 expref: 21 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.399467:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c51e4efb600) 00010000:00010000:0.0:1790710853.399471:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790710853.399657:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281571163 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.399671:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281571163 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.399680:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281571163 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790710853.399741:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:0.0:1790710853.399764:0:5846:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000710043b3 reply state 00000000f8965798 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281571163 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710853.399773:0:5846:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790710853.399877:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f3e77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+23:10353:x1877696158139904:12345-192.168.206.46@tcp:36:truncate.0 Request processed in 505us (772us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1790710853.399885:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 54 00000020:00080000:0.0:1790710853.399890:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1790710853.402568:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281571163 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710853.402584:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281571163 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710853.402591:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281571163 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710853.402597:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c0030000 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1790710853.402602:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281571163 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710853.402610:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281571163 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710853.402624:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c51e4efb600) 00010000:00010000:3.0:1790710853.402628:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790710853.402631:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281571163 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710853.402638:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281571163 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710853.564113:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710853.564274:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158140032 00000100:00100000:0.0:1790710853.564296:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158140032 00000100:00100000:0.0:1790710853.564362:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 55 00000100:00100000:0.0:1790710853.564373:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f3e75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+22:10367:x1877696158140032:12345-192.168.206.46@tcp:101:stat.0 00010000:00010000:0.0:1790710853.564399:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790710853.564418:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030200/0xcbad34b28157116a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b0570004a9 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.564483:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281571171 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.564498:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281571171 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.564509:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281571171 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.564524:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030c00/0xcbad34b281571178 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.564548:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030c00/0xcbad34b281571178 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.564555:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030c00/0xcbad34b281571178 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.565190:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031800/0xcbad34b28157117f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.565201:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031800/0xcbad34b28157117f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.565208:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031800/0xcbad34b28157117f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790710853.565252:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1790710853.565257:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790710853.565279:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031800/0xcbad34b28157117f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.565505:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031800/0xcbad34b28157117f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.565515:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281571171 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.565522:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281571171 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.565529:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281571171 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.565544:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c0030000 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1790710853.565548:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281571171 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.565556:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281571171 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.565568:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c51c2c2ee00) 00010000:00010000:0.0:1790710853.565571:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790710853.565575:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281571171 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.565581:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281571171 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.565594:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030c00/0xcbad34b281571178 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.565599:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030c00/0xcbad34b281571178 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.565605:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030c00/0xcbad34b281571178 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.565609:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c0030c00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1790710853.565612:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030c00/0xcbad34b281571178 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.565618:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030c00/0xcbad34b281571178 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.565636:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c51e4efb700) 00010000:00010000:0.0:1790710853.565639:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790710853.565642:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030c00/0xcbad34b281571178 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.565647:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030c00/0xcbad34b281571178 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.565684:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030200/0xcbad34b28157116a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570004a9 expref: 24 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.565698:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031800/0xcbad34b28157117f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570004a9 expref: 23 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.565704:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c51e4efb600) 00010000:00010000:0.0:1790710853.565706:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790710853.565708:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c0031800, rc 0) 00000100:00100000:0.0:1790710853.565833:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f3e75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+23:10367:x1877696158140032:12345-192.168.206.46@tcp:101:stat.0 Request processed in 1461us (1727us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710853.565851:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 55 00000100:00100000:1.0:1790710853.665485:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710853.665599:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158140288 00000100:00100000:0.0:1790710853.665608:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158140288 00000100:00100000:0.0:1790710853.665670:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 56 00000100:00100000:0.0:1790710853.665680:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c652bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+23:10377:x1877696158140288:12345-192.168.206.46@tcp:101:lfs.0 00010000:00010000:0.0:1790710853.665700:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790710853.665720:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030200/0xcbad34b281571186 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b0570004b0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790710853.665818:0:5846:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1790710853.665941:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030200/0xcbad34b281571186 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570004b0 expref: 25 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.665954:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c51d8e33600) 00010000:00010000:0.0:1790710853.665957:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790710853.665961:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030200/0xcbad34b281571186 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570004b0 expref: 25 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.665974:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c0030200, rc 0) 00000100:00100000:0.0:1790710853.666035:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c652bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+24:10377:x1877696158140288:12345-192.168.206.46@tcp:101:lfs.0 Request processed in 356us (559us total) trans 4294967339 rc 301/301 00000100:00100000:0.0:1790710853.666042:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 56 00000100:00100000:3.0:1790710853.670545:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710853.670648:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158140544 00000100:00100000:1.0:1790710853.670658:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158140544 00000100:00100000:1.0:1790710853.670710:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 14 00000100:00100000:1.0:1790710853.670718:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c652fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+24:10377:x1877696158140544:12345-192.168.206.46@tcp:35:lfs.0 00000100:00100000:1.0:1790710853.670940:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c652fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+25:10377:x1877696158140544:12345-192.168.206.46@tcp:35:lfs.0 Request processed in 221us (402us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1790710853.670948:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 14 00000100:00100000:2.0:1790710853.741103:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710853.741718:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158140800 00000100:00100000:0.0:1790710853.741728:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158140800 00000100:00100000:0.0:1790710853.742071:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 57 00000100:00100000:0.0:1790710853.742083:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f3e74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+25:10383:x1877696158140800:12345-192.168.206.46@tcp:101:bash.0 00010000:00010000:0.0:1790710853.742106:0:8060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790710853.742124:0:8060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030200/0xcbad34b281571194 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b0570004b7 expref: -99 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.742252:0:8060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030c00/0xcbad34b28157119b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.742281:0:8060:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031800/0xcbad34b28157117f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570004a9 expref: 26 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.742310:0:8060:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030c00/0xcbad34b28157119b lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.742363:0:8060:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031800/0xcbad34b28157117f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.46@tcp remote: 0x566877b0570004a9 expref: 26 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.742378:0:8060:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031800/0xcbad34b28157117f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570004a9 expref: 26 pid: 5847 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710853.742394:0:8060:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9ca0380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8060:1877696177044480:192.168.206.46@tcp:104: 00000100:00100000:0.0:1790710853.742498:0:8060:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f50ba240 going to sleep for 11 seconds 00000100:00100000:0.0:1790710853.749542:0:8060:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9ca0380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8060:1877696177044480:192.168.206.46@tcp:104: 00010000:00010000:0.0:1790710853.749576:0:8060:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030c00/0xcbad34b28157119b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710853.752191:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710853.752512:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158140928 00000100:00100000:1.0:1790710853.752522:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158140928 00010000:00010000:1.0:1790710853.752561:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031800/0xcbad34b28157117f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570004a9 expref: 27 pid: 5847 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710853.752602:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 40 00000100:00100000:1.0:1790710853.752611:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f3e74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+27:2358:x1877696158140928:12345-192.168.206.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790710853.752626:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790710853.752633:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031800/0xcbad34b28157117f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570004a9 expref: 27 pid: 5847 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710853.752646:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031800/0xcbad34b28157117f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570004a9 expref: 27 pid: 5847 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710853.752679:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031800/0xcbad34b28157117f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570004a9 expref: 27 pid: 5847 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710853.752698:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c51e4efb600) 00010000:00010000:1.0:1790710853.752702:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030c00/0xcbad34b28157119b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710853.752728:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030c00/0xcbad34b28157119b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710853.752735:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030c00/0xcbad34b28157119b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710853.752772:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790710853.752826:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f3e74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+26:2358:x1877696158140928:12345-192.168.206.46@tcp:103:ldlm_bl.0 Request processed in 215us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710853.752833:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 40 00010000:00010000:0.0:1790710853.753414:0:8060:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030c00/0xcbad34b28157119b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.753425:0:8060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030c00/0xcbad34b28157119b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790710853.753445:0:8060:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1790710853.753586:0:8060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030200/0xcbad34b281571194 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570004b7 expref: 27 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.753602:0:8060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030c00/0xcbad34b28157119b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570004b7 expref: 26 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.753623:0:8060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c51e4efb600) 00010000:00010000:0.0:1790710853.753626:0:8060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790710853.753629:0:8060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c0030c00, rc 0) 00000100:00100000:0.0:1790710853.753672:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f3e74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+26:10383:x1877696158140800:12345-192.168.206.46@tcp:101:bash.0 Request processed in 11592us (12578us total) trans 4294967341 rc 0/0 00000100:00100000:0.0:1790710853.753680:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 57 00000100:00100000:2.0:1790710853.758965:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710853.759023:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158141184 00000100:00100000:0.0:1790710853.759032:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158141184 00000100:00100000:0.0:1790710853.759090:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 58 00000100:00100000:0.0:1790710853.759100:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f3e74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+26:10383:x1877696158141184:12345-192.168.206.46@tcp:36:bash.0 00010000:00010000:0.0:1790710853.759567:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b2815711a9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.759585:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b2815711a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.759595:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b2815711a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790710853.759649:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:0.0:1790710853.759676:0:5846:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000ca87f424 reply state 000000008f68e3aa transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b2815711a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710853.759684:0:5846:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790710853.759816:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f3e74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+29:10383:x1877696158141184:12345-192.168.206.46@tcp:36:bash.0 Request processed in 716us (859us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1790710853.759824:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 58 00000020:00080000:0.0:1790710853.759846:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1790710853.761489:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b2815711a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.761503:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b2815711a9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.761511:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b2815711a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.761517:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c0030000 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1790710853.761522:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b2815711a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.761529:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b2815711a9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.761543:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c51e4efb600) 00010000:00010000:0.0:1790710853.761546:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790710853.761550:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b2815711a9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.761556:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b2815711a9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710853.764745:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710853.765888:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158141312 00000100:00100000:0.0:1790710853.765900:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158141312 00000100:00100000:0.0:1790710853.765973:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 59 00000100:00100000:0.0:1790710853.765983:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f3e75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+28:10383:x1877696158141312:12345-192.168.206.46@tcp:101:bash.0 00010000:00010000:0.0:1790710853.766006:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790710853.766025:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030200/0xcbad34b2815711b0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b0570004be expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.766120:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031600/0xcbad34b2815711b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.766157:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030c00/0xcbad34b28157119b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570004b7 expref: 29 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.766166:0:5847:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031600/0xcbad34b2815711b7 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.766200:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030c00/0xcbad34b28157119b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.46@tcp remote: 0x566877b0570004b7 expref: 29 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.766215:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030c00/0xcbad34b28157119b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570004b7 expref: 29 pid: 8060 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710853.766242:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9ca0380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1877696177044608:192.168.206.46@tcp:104: 00000100:00100000:0.0:1790710853.766335:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f9b2dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790710853.772233:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710853.772314:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158141440 00000100:00100000:3.0:1790710853.772331:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158141440 00010000:00010000:3.0:1790710853.772370:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030c00/0xcbad34b28157119b lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570004b7 expref: 30 pid: 8060 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710853.772411:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 41 00000100:00100000:3.0:1790710853.772432:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c6529500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+30:2358:x1877696158141440:12345-192.168.206.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790710853.772447:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790710853.772454:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030c00/0xcbad34b28157119b lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570004b7 expref: 30 pid: 8060 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710853.772467:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030c00/0xcbad34b28157119b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570004b7 expref: 30 pid: 8060 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710853.772488:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c51e4efb600) 00010000:00010000:3.0:1790710853.772493:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031600/0xcbad34b2815711b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710853.772502:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031600/0xcbad34b2815711b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710853.772511:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031600/0xcbad34b2815711b7 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710853.772532:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790710853.772734:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c6529500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+30:2358:x1877696158141440:12345-192.168.206.46@tcp:103:ldlm_bl.0 Request processed in 302us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710853.772742:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 41 00010000:00010000:0.0:1790710853.772993:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030c00/0xcbad34b28157119b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570004b7 expref: 29 pid: 8060 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710853.773008:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9ca0380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1877696177044608:192.168.206.46@tcp:104: 00010000:00010000:0.0:1790710853.773029:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031600/0xcbad34b2815711b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.773037:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031600/0xcbad34b2815711b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.773052:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031600/0xcbad34b2815711b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790710853.773231:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1790710853.773235:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790710853.773256:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031600/0xcbad34b2815711b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.773286:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030200/0xcbad34b2815711b0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570004be expref: 29 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.773300:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031600/0xcbad34b2815711b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570004be expref: 28 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.773307:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c51e4efb600) 00010000:00010000:0.0:1790710853.773310:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790710853.773312:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c0031600, rc 0) 00000100:00100000:0.0:1790710853.773401:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f3e75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+28:10383:x1877696158141312:12345-192.168.206.46@tcp:101:bash.0 Request processed in 7419us (8664us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710853.773409:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 59 00000100:00100000:3.0:1790710853.777982:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710853.778080:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158141696 00000100:00100000:1.0:1790710853.778090:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158141696 00000100:00100000:1.0:1790710853.778174:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 15 00000100:00100000:1.0:1790710853.778185:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d6262450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+28:10383:x1877696158141696:12345-192.168.206.46@tcp:35:bash.0 00000100:00100000:1.0:1790710853.778412:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d6262450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+29:10383:x1877696158141696:12345-192.168.206.46@tcp:35:bash.0 Request processed in 228us (437us total) trans 4294967344 rc 0/0 00000100:00100000:1.0:1790710853.778420:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 15 00000100:00100000:2.0:1790710853.878876:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710853.879015:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158141952 00000100:00100000:1.0:1790710853.879024:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158141952 00000100:00100000:1.0:1790710853.879086:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 60 00000100:00100000:1.0:1790710853.879096:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f3e74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+29:10393:x1877696158141952:12345-192.168.206.46@tcp:101:lfs.0 00010000:00010000:1.0:1790710853.879119:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790710853.879163:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b2815711be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b0570004c5 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790710853.879256:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1790710853.879394:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b2815711be lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570004c5 expref: 31 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710853.879408:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c51d8e33600) 00010000:00010000:1.0:1790710853.879411:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790710853.879416:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b2815711be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570004c5 expref: 31 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710853.879428:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c6480e00, rc 0) 00000100:00100000:1.0:1790710853.879674:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f3e74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+30:10393:x1877696158141952:12345-192.168.206.46@tcp:101:lfs.0 Request processed in 578us (807us total) trans 4294967345 rc 301/301 00000100:00100000:1.0:1790710853.879682:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 60 00000100:00100000:2.0:1790710853.883854:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710853.884590:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158142080 00000100:00100000:1.0:1790710853.884601:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158142080 00000100:00100000:1.0:1790710853.884719:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 61 00000100:00100000:1.0:1790710853.884730:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff60c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+30:10393:x1877696158142080:12345-192.168.206.46@tcp:34:lfs.0 00010000:00010000:1.0:1790710853.884996:0:8060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b2815711cc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710853.885014:0:8060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b2815711cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710853.885100:0:8060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b2815711cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710853.885116:0:8060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481200/0xcbad34b2815711d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710853.885124:0:8060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481200/0xcbad34b2815711d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710853.885169:0:8060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481200/0xcbad34b2815711d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710853.885588:0:8060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b2815711da lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710853.885598:0:8060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b2815711da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710853.885605:0:8060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b2815711da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790710853.885644:0:8060:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b2815711da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710853.885726:0:8060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b2815711cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710853.885734:0:8060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b2815711cc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710853.885946:0:8060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b2815711cc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710853.885953:0:8060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c6481000 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1790710853.885957:0:8060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b2815711cc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710853.885965:0:8060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b2815711cc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710853.885977:0:8060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c51c2c2ee00) 00010000:00010000:1.0:1790710853.885987:0:8060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790710853.885992:0:8060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b2815711cc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710853.885999:0:8060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b2815711cc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710853.886012:0:8060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481200/0xcbad34b2815711d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710853.886528:0:8060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481200/0xcbad34b2815711d3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710853.886536:0:8060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481200/0xcbad34b2815711d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710853.886540:0:8060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c6481200 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1790710853.886544:0:8060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481200/0xcbad34b2815711d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710853.886551:0:8060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481200/0xcbad34b2815711d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710853.886559:0:8060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c51d8e33d00) 00010000:00010000:1.0:1790710853.886562:0:8060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790710853.886565:0:8060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481200/0xcbad34b2815711d3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710853.886570:0:8060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481200/0xcbad34b2815711d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710853.886588:0:8060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b2815711da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710853.886602:0:8060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b2815711da lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710853.886608:0:8060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b2815711da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710853.886613:0:8060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c6480e00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1790710853.886616:0:8060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b2815711da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710853.886633:0:8060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b2815711da lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710853.886641:0:8060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c51e4efb600) 00010000:00010000:1.0:1790710853.886643:0:8060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790710853.886646:0:8060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b2815711da lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710853.886659:0:8060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b2815711da lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710853.886764:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff60c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+30:10393:x1877696158142080:12345-192.168.206.46@tcp:34:lfs.0 Request processed in 2032us (2926us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710853.886773:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 61 00000100:00100000:3.0:1790710853.889268:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710853.889428:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158142336 00000100:00100000:1.0:1790710853.889438:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158142336 00000100:00100000:1.0:1790710853.889537:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 16 00000100:00100000:1.0:1790710853.889547:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c652d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+30:10393:x1877696158142336:12345-192.168.206.46@tcp:35:lfs.0 00000100:00100000:1.0:1790710853.889777:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c652d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+31:10393:x1877696158142336:12345-192.168.206.46@tcp:35:lfs.0 Request processed in 231us (517us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1790710853.889807:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 16 00000100:00100000:2.0:1790710853.943656:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710853.945839:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158142592 00000100:00100000:0.0:1790710853.945854:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158142592 00000100:00100000:0.0:1790710853.946867:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 62 00000100:00100000:0.0:1790710853.946879:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff60df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+31:10396:x1877696158142592:12345-192.168.206.46@tcp:101:lfs.0 00010000:00010000:0.0:1790710853.946905:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790710853.946924:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030200/0xcbad34b2815711e1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b0570004cc expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.947008:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030c00/0xcbad34b2815711e8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.947022:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030c00/0xcbad34b2815711e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.947032:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030c00/0xcbad34b2815711e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.947045:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b2815711ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.947052:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b2815711ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.947058:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b2815711ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.947412:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031800/0xcbad34b2815711f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.947421:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031800/0xcbad34b2815711f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.947428:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031800/0xcbad34b2815711f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790710853.947437:0:5846:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1790710853.947525:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030c00/0xcbad34b2815711e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.947533:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030c00/0xcbad34b2815711e8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.947546:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030c00/0xcbad34b2815711e8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.947552:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c0030c00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1790710853.947556:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030c00/0xcbad34b2815711e8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.947564:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030c00/0xcbad34b2815711e8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.947575:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c51c2c2ee00) 00010000:00010000:0.0:1790710853.947578:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790710853.947582:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030c00/0xcbad34b2815711e8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.947588:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030c00/0xcbad34b2815711e8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.947600:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b2815711ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.947605:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b2815711ef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.947610:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b2815711ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.947613:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c0030000 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1790710853.947616:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b2815711ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.947640:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b2815711ef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.947647:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c51e4efb700) 00010000:00010000:0.0:1790710853.947649:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790710853.947652:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b2815711ef lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.947657:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b2815711ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.947694:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030200/0xcbad34b2815711e1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570004cc expref: 34 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.947704:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031800/0xcbad34b2815711f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570004cc expref: 33 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710853.947711:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c51e4efb600) 00010000:00010000:0.0:1790710853.947713:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790710853.947715:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c0031800, rc 0) 00000100:00100000:0.0:1790710853.947780:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff60df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+33:10396:x1877696158142592:12345-192.168.206.46@tcp:101:lfs.0 Request processed in 905us (4132us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1790710853.947787:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 62 00000100:00100000:2.0:1790710853.953360:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710853.953405:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710853.953607:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158142848 00000100:00100000:3.0:1790710853.953618:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158142848 00000100:00100000:3.0:1790710853.953695:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 4 00000100:00100000:3.0:1790710853.953704:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff60fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+33:2356:x1877696158142848:12345-192.168.206.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790710853.953738:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790710853.953762:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031800/0xcbad34b2815711f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570004cc expref: 33 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710853.953781:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c51e4efb600) 00010000:00010000:3.0:1790710853.953786:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790710853.953850:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff60fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+32:2356:x1877696158142848:12345-192.168.206.46@tcp:103:ldlm_bl.0 Request processed in 134us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710853.953857:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 4 00000100:00100000:1.0:1790710853.954175:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158142720 00000100:00100000:1.0:1790710853.954181:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158142720 00000100:00100000:1.0:1790710853.954232:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 63 00000100:00100000:1.0:1790710853.954240:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff60ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+32:10396:x1877696158142720:12345-192.168.206.46@tcp:54:lfs.0 00010000:00010000:1.0:1790710853.954296:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b281571204 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710853.954310:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b281571204 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710853.954320:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b281571204 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710853.954475:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b281571204 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710853.954483:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b281571204 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710853.954490:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b281571204 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710853.954496:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c6480e00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1790710853.954501:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b281571204 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710853.954509:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b281571204 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710853.954519:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c51e4efb600) 00010000:00010000:1.0:1790710853.954531:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790710853.954536:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b281571204 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710853.954542:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b281571204 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710853.954594:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff60ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+32:10396:x1877696158142720:12345-192.168.206.46@tcp:54:lfs.0 Request processed in 354us (1242us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710853.954600:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 63 00000100:00100000:2.0:1790710853.958917:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710853.958982:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158143104 00000100:00100000:0.0:1790710853.958991:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158143104 00000100:00100000:0.0:1790710853.959042:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 17 00000100:00100000:0.0:1790710853.959052:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff60d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+32:10396:x1877696158143104:12345-192.168.206.46@tcp:35:lfs.0 00000100:00100000:0.0:1790710853.959321:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff60d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+33:10396:x1877696158143104:12345-192.168.206.46@tcp:35:lfs.0 Request processed in 270us (410us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1790710853.959329:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 17 00000100:00100000:3.0:1790710854.126193:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710854.126262:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158143360 00000100:00100000:1.0:1790710854.126272:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158143360 00000100:00100000:1.0:1790710854.126384:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 64 00000100:00100000:1.0:1790710854.126395:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c652e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+33:10414:x1877696158143360:12345-192.168.206.46@tcp:101:cat.0 00010000:00010000:1.0:1790710854.126418:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790710854.126436:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b28157120b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b0570004d3 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710854.126653:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481200/0xcbad34b281571212 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710854.126669:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481200/0xcbad34b281571212 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710854.126680:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481200/0xcbad34b281571212 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790710854.126691:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1790710854.126826:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b28157120b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570004d3 expref: 36 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710854.126862:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481200/0xcbad34b281571212 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570004d3 expref: 35 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710854.126872:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c51e4efb600) 00010000:00010000:1.0:1790710854.126875:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1790710854.126878:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c6481200, rc 0) 00000100:00100000:1.0:1790710854.126947:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c652e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+35:10414:x1877696158143360:12345-192.168.206.46@tcp:101:cat.0 Request processed in 553us (762us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1790710854.126955:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 64 00010000:00010000:2.0:1790710854.151494:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790710854.161264:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710854.161351:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158143488 00000100:00100000:1.0:1790710854.161360:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158143488 00000100:00100000:1.0:1790710854.161416:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 65 00000100:00100000:1.0:1790710854.161426:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff60ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+35:10415:x1877696158143488:12345-192.168.206.46@tcp:101:lfs.0 00010000:00010000:1.0:1790710854.161450:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790710854.161469:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b281571220 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b0570004da expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710854.161529:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571227 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710854.161543:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571227 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710854.161554:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571227 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790710854.161585:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1790710854.161600:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790710854.161620:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571227 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710854.161647:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b281571220 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570004da expref: 37 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710854.161665:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571227 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570004da expref: 36 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710854.161674:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c51c2c2ee00) 00010000:00010000:1.0:1790710854.161677:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790710854.161680:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c6481000, rc 0) 00000100:00100000:1.0:1790710854.161740:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff60ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+36:10415:x1877696158143488:12345-192.168.206.46@tcp:101:lfs.0 Request processed in 315us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710854.161748:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 65 00000100:00100000:3.0:1790710854.172693:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710854.177268:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158143872 00000100:00100000:0.0:1790710854.177282:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158143872 00000100:00100000:0.0:1790710854.177567:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 18 00000100:00100000:0.0:1790710854.177579:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c652fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+36:10415:x1877696158143872:12345-192.168.206.46@tcp:35:lfs.0 00000100:00100000:0.0:1790710854.178027:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c652fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+37:10415:x1877696158143872:12345-192.168.206.46@tcp:35:lfs.0 Request processed in 449us (5340us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1790710854.178036:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 18 00000100:00100000:3.0:1790710854.182263:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710854.182358:0:8449:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158144000 00000100:00100000:1.0:1790710854.182374:0:8449:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158144000 00000100:00100000:1.0:1790710854.182428:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 5 00000100:00100000:1.0:1790710854.182437:0:8449:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c652f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+37:10415:x1877696158144000:12345-192.168.206.46@tcp:103:lfs.0 00010000:00010000:1.0:1790710854.182451:0:8449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1790710854.182473:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031600/0xcbad34b2815711b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570004be expref: 37 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710854.182494:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481200/0xcbad34b281571212 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570004d3 expref: 36 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710854.182505:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031a00/0xcbad34b2815710bb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700047f expref: 35 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710854.182527:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c51e4efb600) 00010000:00010000:1.0:1790710854.182536:0:8449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790710854.182590:0:8449:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c652f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+34:10415:x1877696158144000:12345-192.168.206.46@tcp:103:lfs.0 Request processed in 154us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710854.182597:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 5 00000100:00100000:2.0:1790710854.186359:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710854.186648:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158144128 00000100:00100000:1.0:1790710854.186657:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158144128 00000100:00100000:1.0:1790710854.186716:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 66 00000100:00100000:1.0:1790710854.186725:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff60f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+34:10415:x1877696158144128:12345-192.168.206.46@tcp:58:lfs.0 00010000:00010000:1.0:1790710854.186854:0:8060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b28157122e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710854.186872:0:8060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b28157122e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710854.186882:0:8060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b28157122e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790710854.189009:0:8060:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790710854.190204:0:8060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1790710854.190294:0:8060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1790710854.190564:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff60f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+34:10415:x1877696158144128:12345-192.168.206.46@tcp:58:lfs.0 Request processed in 3833us (4206us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710854.190585:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 66 00000100:00100000:2.0:1790710854.216433:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710854.216525:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158144256 00000100:00100000:1.0:1790710854.216535:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158144256 00000100:00100000:1.0:1790710854.216592:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 67 00000100:00100000:1.0:1790710854.216601:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff60d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+34:10417:x1877696158144256:12345-192.168.206.46@tcp:101:lfs.0 00010000:00010000:1.0:1790710854.216634:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790710854.216654:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481200/0xcbad34b281571235 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b0570004e1 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710854.216717:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b28157123c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710854.216733:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b28157123c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710854.216743:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b28157123c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710854.216756:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480200/0xcbad34b281571243 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710854.216764:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480200/0xcbad34b281571243 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710854.216770:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480200/0xcbad34b281571243 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710854.217000:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b28157124a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710854.217011:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b28157124a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710854.217017:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b28157124a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790710854.217053:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1790710854.217073:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790710854.217096:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b28157124a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710854.217107:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b28157124a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710854.217114:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b28157123c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710854.217120:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b28157123c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710854.217183:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b28157123c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710854.217189:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c6480c00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1790710854.217194:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b28157123c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710854.217201:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b28157123c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710854.217212:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c51c2c2ee00) 00010000:00010000:1.0:1790710854.217224:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790710854.217228:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b28157123c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710854.217234:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b28157123c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710854.217246:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480200/0xcbad34b281571243 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710854.217260:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480200/0xcbad34b281571243 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710854.217266:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480200/0xcbad34b281571243 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710854.217270:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c6480200 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1790710854.217273:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480200/0xcbad34b281571243 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710854.217279:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480200/0xcbad34b281571243 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710854.217285:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c51d8e33e00) 00010000:00010000:1.0:1790710854.217287:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790710854.217290:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480200/0xcbad34b281571243 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710854.217295:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480200/0xcbad34b281571243 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710854.217324:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481200/0xcbad34b281571235 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570004e1 expref: 36 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710854.217336:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b28157124a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570004e1 expref: 35 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710854.217343:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c51d8e33d00) 00010000:00010000:1.0:1790710854.217345:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790710854.217352:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c6481c00, rc 0) 00000100:00100000:1.0:1790710854.217403:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff60d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+35:10417:x1877696158144256:12345-192.168.206.46@tcp:101:lfs.0 Request processed in 803us (979us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710854.217411:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 67 00000040:00080000:1.0:1790710854.856326:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790710854.856336:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790710854.856404:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1790710854.856410:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790710854.856520:0:11676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c6528a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11676:1877696177044736:192.168.206.46@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790710854.856611:0:11676:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c3f8ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790710854.861547:0:11676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c6528a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11676:1877696177044736:192.168.206.46@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790710854.862471:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710854.862557:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158144384 00000100:00100000:3.0:1790710854.862564:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158144384 00000100:00100000:3.0:1790710854.862655:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 1 00000100:00100000:3.0:1790710854.862665:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff60d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+35:10428:x1877696158144384:12345-192.168.206.46@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1790710854.862746:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff60d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+35:10428:x1877696158144384:12345-192.168.206.46@tcp:900:lhsmtool_posix.0 Request processed in 83us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710854.862753:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 1 00000100:00100000:2.0:1790710854.867118:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710854.867389:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158144512 00000100:00100000:3.0:1790710854.867398:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158144512 00000100:00100000:3.0:1790710854.867455:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 68 00000100:00100000:3.0:1790710854.867465:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff60c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+35:10428:x1877696158144512:12345-192.168.206.46@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1790710854.867495:0:5845:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1790710854.867636:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff60c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+35:10428:x1877696158144512:12345-192.168.206.46@tcp:53:lhsmtool_posix.0 Request processed in 172us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710854.867658:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 68 00000100:00100000:0.0:1790710854.875756:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710854.876750:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158144640 00000100:00100000:1.0:1790710854.876760:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158144640 00000100:00100000:1.0:1790710854.876862:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 69 00000100:00100000:1.0:1790710854.876873:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9ca0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+35:10428:x1877696158144640:12345-192.168.206.46@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1790710854.876955:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481400/0xcbad34b281571251 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710854.876973:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481400/0xcbad34b281571251 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710854.876987:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481400/0xcbad34b281571251 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710854.877051:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481a00/0xcbad34b281571258 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710854.877267:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481a00/0xcbad34b281571258 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710854.877297:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481a00/0xcbad34b281571258 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710854.877325:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b28157125f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710854.877392:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b28157125f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710854.877401:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b28157125f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790710854.877438:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1790710854.877442:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790710854.877462:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b28157125f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710854.877475:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481400/0xcbad34b281571251 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710854.877482:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481400/0xcbad34b281571251 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710854.877491:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481400/0xcbad34b281571251 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710854.877496:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c6481400 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1790710854.877511:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481400/0xcbad34b281571251 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710854.877518:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481400/0xcbad34b281571251 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710854.877543:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c51cca25300) 00010000:00010000:1.0:1790710854.877547:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790710854.877551:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481400/0xcbad34b281571251 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710854.877557:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481400/0xcbad34b281571251 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710854.877570:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481a00/0xcbad34b281571258 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710854.877576:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481a00/0xcbad34b281571258 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710854.877582:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481a00/0xcbad34b281571258 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710854.877587:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c6481a00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1790710854.877589:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481a00/0xcbad34b281571258 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710854.877595:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481a00/0xcbad34b281571258 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710854.877603:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9c51d8e33e00) 00010000:00010000:1.0:1790710854.877605:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790710854.877608:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481a00/0xcbad34b281571258 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710854.877619:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481a00/0xcbad34b281571258 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710854.877649:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b28157125f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710854.877655:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b28157125f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710854.877662:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b28157125f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710854.877667:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c6480c00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1790710854.877670:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b28157125f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710854.877676:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b28157125f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710854.877684:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c51d8e33d00) 00010000:00010000:1.0:1790710854.877686:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790710854.877689:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b28157125f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710854.877695:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b28157125f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710854.877778:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9ca0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+35:10428:x1877696158144640:12345-192.168.206.46@tcp:34:lhsmtool_posix.0 Request processed in 905us (2028us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710854.877786:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 69 00000100:00100000:2.0:1790710854.882178:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710854.882379:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158144896 00000100:00100000:3.0:1790710854.882389:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158144896 00000100:00100000:3.0:1790710854.882441:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 70 00000100:00100000:3.0:1790710854.882451:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff60ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+35:10428:x1877696158144896:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790710854.882472:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790710854.882490:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216a600/0xcbad34b281571266 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b0570004e8 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710854.882577:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216b600/0xcbad34b28157126d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710854.882591:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216b600/0xcbad34b28157126d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710854.882601:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216b600/0xcbad34b28157126d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790710854.882613:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1790710854.882705:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216b600/0xcbad34b28157126d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710854.882713:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216b600/0xcbad34b28157126d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710854.882720:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216b600/0xcbad34b28157126d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710854.882726:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c520216b600 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1790710854.882730:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216b600/0xcbad34b28157126d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710854.882750:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216b600/0xcbad34b28157126d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710854.882763:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c51d8e33d00) 00010000:00010000:3.0:1790710854.882766:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790710854.882771:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216b600/0xcbad34b28157126d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710854.882778:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216b600/0xcbad34b28157126d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710854.882816:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216a600/0xcbad34b281571266 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570004e8 expref: 37 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710854.882827:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c51cca25300) 00010000:00010000:3.0:1790710854.882829:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790710854.882833:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216a600/0xcbad34b281571266 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570004e8 expref: 37 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710854.882843:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c520216a600, rc 0) 00000100:00100000:3.0:1790710854.882907:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff60ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+36:10428:x1877696158144896:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 Request processed in 457us (737us total) trans 4294967351 rc 301/301 00000100:00100000:3.0:1790710854.882915:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 70 00000100:00100000:2.0:1790710854.887782:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710854.893812:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158145024 00000100:00100000:0.0:1790710854.893826:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158145024 00000100:00100000:0.0:1790710854.893904:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 71 00000100:00100000:0.0:1790710854.893915:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff60f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+36:10428:x1877696158145024:12345-192.168.206.46@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1790710854.893948:0:5846:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1790710854.894047:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff60f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+36:10428:x1877696158145024:12345-192.168.206.46@tcp:53:lhsmtool_posix.0 Request processed in 134us (6274us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710854.894055:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 71 00000100:00100000:3.0:1790710854.901753:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710854.901986:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158145280 00000100:00100000:1.0:1790710854.901996:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158145280 00000100:00100000:1.0:1790710854.902054:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 72 00000100:00100000:1.0:1790710854.902084:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4866680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+36:10428:x1877696158145280:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790710854.902103:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790710854.902106:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1790710854.902161:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571227 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570004da expref: 36 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710854.902180:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c51c2c2ee00) 00010000:00010000:1.0:1790710854.902185:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790710854.902197:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b28157127b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b0570004ef expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790710854.902778:0:5845:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:1.0:1790710854.903022:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481a00/0xcbad34b281571282 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710854.903036:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481a00/0xcbad34b281571282 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710854.903046:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481a00/0xcbad34b281571282 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710854.903096:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b28157127b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570004ef expref: 38 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710854.903112:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481a00/0xcbad34b281571282 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570004ef expref: 37 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710854.903120:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c51d8e33e00) 00010000:00010000:1.0:1790710854.903123:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790710854.903173:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c6481a00, rc 0) 00000100:00100000:1.0:1790710854.903242:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4866680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+37:10428:x1877696158145280:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 Request processed in 1160us (1498us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1790710854.903251:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 72 00000100:00100000:3.0:1790710854.913663:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710854.913694:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158145536 00000100:00100000:3.0:1790710854.913702:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158145536 00000100:00100000:3.0:1790710854.913748:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 73 00000100:00100000:3.0:1790710854.913772:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4864000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+37:10428:x1877696158145536:12345-192.168.206.46@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790710854.913822:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790710854.913845:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481a00/0xcbad34b281571282 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570004ef expref: 37 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710854.913864:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c51d8e33e00) 00010000:00010000:3.0:1790710854.913875:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790710854.913896:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216be00/0xcbad34b281571290 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710854.913910:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216be00/0xcbad34b281571290 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710854.913919:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216be00/0xcbad34b281571290 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710854.913932:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216a600/0xcbad34b281571297 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x4f2cdb7c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710854.913939:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216a600/0xcbad34b281571297 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x4f2cdb7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710854.913945:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216a600/0xcbad34b281571297 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x4f2cdb7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710854.915763:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216be00/0xcbad34b281571290 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710854.915777:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216be00/0xcbad34b281571290 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710854.915793:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216be00/0xcbad34b281571290 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710854.915799:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c520216be00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1790710854.915803:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216be00/0xcbad34b281571290 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710854.915809:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216be00/0xcbad34b281571290 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710854.915822:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c51c2c2ee00) 00010000:00010000:3.0:1790710854.915825:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790710854.915829:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216be00/0xcbad34b281571290 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710854.915834:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216be00/0xcbad34b281571290 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710854.915844:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216a600/0xcbad34b281571297 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x4f2cdb7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710854.915850:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216a600/0xcbad34b281571297 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x4f2cdb7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710854.915855:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216a600/0xcbad34b281571297 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x4f2cdb7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710854.915861:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c520216a600 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1790710854.915864:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216a600/0xcbad34b281571297 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x4f2cdb7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710854.915879:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216a600/0xcbad34b281571297 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x4f2cdb7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710854.915887:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x4f2cdb7c (ffff9c51c2c2eb00) 00010000:00010000:3.0:1790710854.915889:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790710854.915892:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216a600/0xcbad34b281571297 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x4f2cdb7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710854.915898:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216a600/0xcbad34b281571297 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x4f2cdb7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710854.916247:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4864000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+36:10428:x1877696158145536:12345-192.168.206.46@tcp:36:lhsmtool_posix.0 Request processed in 2473us (2589us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790710854.916256:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 73 00000100:00100000:0.0:1790710854.931720:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710854.931787:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158145664 00000100:00100000:3.0:1790710854.931796:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158145664 00000100:00100000:3.0:1790710854.931848:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 74 00000100:00100000:3.0:1790710854.931858:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+36:10428:x1877696158145664:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790710854.931878:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790710854.931904:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216a600/0xcbad34b28157129e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b0570004f6 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710854.931936:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216be00/0xcbad34b2815712a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710854.931949:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216be00/0xcbad34b2815712a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710854.931960:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216be00/0xcbad34b2815712a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710854.932059:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216a600/0xcbad34b28157129e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570004f6 expref: 38 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710854.932076:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216be00/0xcbad34b2815712a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570004f6 expref: 37 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710854.932085:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c51c2c2eb00) 00010000:00010000:3.0:1790710854.932088:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790710854.932091:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c520216be00, rc 0) 00000100:00100000:3.0:1790710854.932178:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+37:10428:x1877696158145664:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 Request processed in 321us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710854.932185:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 74 00000100:00100000:0.0:1790710854.936804:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710854.936883:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158145920 00000100:00100000:3.0:1790710854.936892:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158145920 00000100:00100000:3.0:1790710854.936947:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 75 00000100:00100000:3.0:1790710854.936956:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f8ce4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+37:10428:x1877696158145920:12345-192.168.206.46@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790710854.937074:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216b600/0xcbad34b2815712ac lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710854.937092:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216b600/0xcbad34b2815712ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710854.937102:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216b600/0xcbad34b2815712ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790710854.937437:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:3.0:1790710854.937447:0:5846:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 332274318832ns, next at 333274316715ns, rc = 0 00000004:00010000:3.0:1790710854.937525:0:5846:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000e551793d reply state 000000003e4fa339 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216b600/0xcbad34b2815712ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710854.937534:0:5846:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790710854.937626:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f8ce4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+39:10428:x1877696158145920:12345-192.168.206.46@tcp:36:lhsmtool_posix.0 Request processed in 670us (831us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1790710854.937634:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 75 00000100:00100000:0.0:1790710854.939157:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00010000:00010000:3.0:1790710854.939291:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216b600/0xcbad34b2815712ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710854.939302:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216b600/0xcbad34b2815712ac lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710854.939308:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216b600/0xcbad34b2815712ac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710854.939314:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c520216b600 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1790710854.939318:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216b600/0xcbad34b2815712ac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710854.939326:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216b600/0xcbad34b2815712ac lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710854.939339:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c51c2c2eb00) 00010000:00010000:3.0:1790710854.939342:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790710854.939347:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216b600/0xcbad34b2815712ac lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710854.939353:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216b600/0xcbad34b2815712ac lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710854.939380:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158146048 00000100:00100000:3.0:1790710854.939396:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158146048 00000100:00100000:3.0:1790710854.939432:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 76 00000100:00100000:3.0:1790710854.939440:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f8ce7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+38:10428:x1877696158146048:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790710854.939460:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790710854.939474:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1644a00/0xcbad34b2815712b3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b0570004fd expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710854.939522:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1644a00/0xcbad34b2815712b3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570004fd expref: 39 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710854.939533:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1644a00/0xcbad34b2815712b3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570004fd expref: 39 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710854.939549:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c51c2c2eb00) 00010000:00010000:3.0:1790710854.939552:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790710854.939554:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c1644a00, rc 0) 00000100:00100000:3.0:1790710854.939597:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f8ce7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+39:10428:x1877696158146048:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 Request processed in 157us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710854.939604:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 76 00000100:00100000:3.0:1790710854.948347:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710854.948439:0:6696:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158146176 00000100:00100000:0.0:1790710854.948449:0:6696:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158146176 00000100:00100000:0.0:1790710854.948492:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 25 00000100:00100000:0.0:1790710854.948500:0:6696:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff1ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2355:x1877696158146176:12345-192.168.206.46@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1790710854.948540:0:6696:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 0ec73bd1-726e-4dc0-8edd-807d3f973d65@192.168.206.46@tcp t0 exp 0000000000000000 cur 332 last 0 00000020:00000080:0.0:1790710854.948567:0:6696:0:(genops.c:1384:class_connect()) connect: client 0ec73bd1-726e-4dc0-8edd-807d3f973d65, cookie 0xcbad34b2815712ba 00002000:00100000:0.0:1790710854.948580:0:6696:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0ec73bd1-726e-4dc0-8edd-807d3f973d65/ffff9c51c71c8800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790710854.948604:0:6696:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1790710854.948826:0:6696:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1790710854.948852:0:6696:0:(import.c:65:import_set_state_nolock()) ffff9c51c71c8000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790710854.948917:0:6696:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff1ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:2355:x1877696158146176:12345-192.168.206.46@tcp:8:lhsmtool_posix.0 Request processed in 416us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710854.948926:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 25 00000100:00100000:0.0:1790710854.955578:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710854.955657:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158146304 00000100:00100000:3.0:1790710854.955666:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158146304 00000100:00100000:3.0:1790710854.955734:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 26 00000100:00100000:3.0:1790710854.955743:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:0:x1877696158146304:12345-192.168.206.46@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1790710854.956026:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790710855.038923:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+7:0:x1877696158146304:12345-192.168.206.46@tcp:2:lhsmtool_posix.0 Request processed in 83169us (83347us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1790710855.038936:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 26 00000001:00100000:1.0:1790710855.038965:0:7643:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0ec73bd1-726e-4dc0-8edd-807d3f973d65 00000001:00080000:1.0:1790710855.038976:0:7643:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:0.0:1790710855.043940:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710855.047263:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158146560 00000100:00100000:3.0:1790710855.047280:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158146560 00000100:00100000:3.0:1790710855.047362:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 19 00000100:00100000:3.0:1790710855.047380:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+39:10428:x1877696158146560:12345-192.168.206.46@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1790710855.047599:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+40:10428:x1877696158146560:12345-192.168.206.46@tcp:35:lhsmtool_posix.0 Request processed in 220us (3664us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1790710855.047606:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 19 00000100:00080000:0.0:1790710855.049183:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790710855.051458:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710855.051531:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158146816 00000100:00100000:3.0:1790710855.051543:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158146816 00000100:00100000:3.0:1790710855.051638:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 77 00000100:00100000:3.0:1790710855.051649:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c6528a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+40:10428:x1877696158146816:12345-192.168.206.46@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1790710855.051777:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c6528a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+40:10428:x1877696158146816:12345-192.168.206.46@tcp:57:lhsmtool_posix.0 Request processed in 130us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710855.051786:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 77 00000100:00100000:0.0:1790710855.064243:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710855.064337:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158146944 00000100:00100000:3.0:1790710855.064346:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158146944 00000100:00100000:3.0:1790710855.064405:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 78 00000100:00100000:3.0:1790710855.064415:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+40:10428:x1877696158146944:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790710855.064437:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790710855.064457:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645e00/0xcbad34b2815712c1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b057000504 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710855.064525:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645800/0xcbad34b2815712c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710855.064540:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645800/0xcbad34b2815712c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710855.064551:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645800/0xcbad34b2815712c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790710855.064599:0:5845:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790710855.064617:0:5845:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645800/0xcbad34b2815712c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710855.064644:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645e00/0xcbad34b2815712c1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000504 expref: 42 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710855.064662:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645800/0xcbad34b2815712c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000504 expref: 41 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710855.064670:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c51c2c2eb00) 00010000:00010000:3.0:1790710855.064673:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1790710855.064677:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c1645800, rc 0) 00000100:00100000:3.0:1790710855.064740:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+41:10428:x1877696158146944:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 Request processed in 326us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710855.064748:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 78 00000040:00080000:2.0:1790710855.071331:0:11990:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790710855.071341:0:11990:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790710855.071374:0:11990:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1790710855.071379:0:11990:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790710855.077192:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710855.078624:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158147072 00000100:00100000:3.0:1790710855.078638:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158147072 00000100:00100000:3.0:1790710855.078702:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 27 00000100:00100000:3.0:1790710855.078719:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c652b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+5:2359:x1877696158147072:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790710855.078737:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790710855.078759:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088a37ce1/0xcbad34b2815712cf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b05700050b expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790710855.078786:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abc1446, blocks: 0x1 00010000:00010000:3.0:1790710855.078819:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=332s v=(0 0) 00010000:00010000:3.0:1790710855.078828:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790710855.078838:0:6697:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088a37ce1/0xcbad34b2815712cf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700050b expref: 6 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710855.078935:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000088a37ce1/0xcbad34b2815712cf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700050b expref: 6 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710855.078950:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c1645e00, rc 0) 00000100:00100000:3.0:1790710855.079011:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c652b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:2359:x1877696158147072:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 Request processed in 301us (1826us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710855.079019:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 27 00000100:00100000:0.0:1790710855.085639:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710855.085707:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158147328 00000100:00100000:1.0:1790710855.085718:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158147328 00000100:00100000:1.0:1790710855.085780:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 79 00000100:00100000:1.0:1790710855.085790:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+41:10428:x1877696158147328:12345-192.168.206.46@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1790710855.085922:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+41:10428:x1877696158147328:12345-192.168.206.46@tcp:57:lhsmtool_posix.0 Request processed in 133us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710855.085931:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 79 00000100:00100000:3.0:1790710855.091261:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710855.091417:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158147456 00000100:00100000:1.0:1790710855.091427:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158147456 00000100:00100000:1.0:1790710855.091478:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 28 00000100:00100000:1.0:1790710855.091488:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff1ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:10428:x1877696158147456:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790710855.091506:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790710855.091524:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aa52bd29/0xcbad34b2815712d6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b057000512 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710855.091567:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000088a37ce1/0xcbad34b2815712cf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700050b expref: 7 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710855.091577:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790710855.091581:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790710855.091586:0:6698:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa52bd29/0xcbad34b2815712d6 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000512 expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710855.091618:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000088a37ce1/0xcbad34b2815712cf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.46@tcp remote: 0x566877b05700050b expref: 7 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710855.091632:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000088a37ce1/0xcbad34b2815712cf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.46@tcp remote: 0x566877b05700050b expref: 7 pid: 6697 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710855.091647:0:6698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c6529180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1877696177044864:192.168.206.46@tcp:104: 00000100:00100000:1.0:1790710855.091732:0:6698:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c3f8c540 going to sleep for 11 seconds 00000100:00100000:0.0:1790710855.095495:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710855.095523:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158147584 00000100:00100000:0.0:1790710855.095530:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158147584 00010000:00010000:0.0:1790710855.095567:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000088a37ce1/0xcbad34b2815712cf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.46@tcp remote: 0x566877b05700050b expref: 8 pid: 6697 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710855.095605:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 42 00000100:00100000:0.0:1790710855.095613:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8e5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+8:2358:x1877696158147584:12345-192.168.206.46@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1790710855.095805:0:6698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c6529180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1877696177044864:192.168.206.46@tcp:104: 00010000:00010000:1.0:1790710855.096149:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000aa52bd29/0xcbad34b2815712d6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.46@tcp remote: 0x566877b057000512 expref: 8 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710855.096169:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c6481200, rc 0) 00000100:00100000:1.0:1790710855.096238:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff1ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+8:10428:x1877696158147456:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 Request processed in 4751us (4986us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710855.096246:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 28 00010000:00010000:0.0:1790710855.096523:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790710855.096547:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000088a37ce1/0xcbad34b2815712cf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.46@tcp remote: 0x566877b05700050b expref: 7 pid: 6697 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710855.096567:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000088a37ce1/0xcbad34b2815712cf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.46@tcp remote: 0x566877b05700050b expref: 7 pid: 6697 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710855.096591:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088a37ce1/0xcbad34b2815712cf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.46@tcp remote: 0x566877b05700050b expref: 7 pid: 6697 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710855.096605:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790710855.096609:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790710855.096616:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000aa52bd29/0xcbad34b2815712d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.46@tcp remote: 0x566877b057000512 expref: 6 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710855.096626:0:5829:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa52bd29/0xcbad34b2815712d6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.46@tcp remote: 0x566877b057000512 expref: 6 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710855.096660:0:5829:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000aa52bd29/0xcbad34b2815712d6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.46@tcp remote: 0x566877b057000512 expref: 6 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710855.096673:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d5fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5829:1877696177044992:192.168.206.46@tcp:105: 00000100:00100000:0.0:1790710855.096732:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c8dc7cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790710855.104830:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d5fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5829:1877696177044992:192.168.206.46@tcp:105: 00010000:00010000:3.0:1790710855.104918:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790710855.104976:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8e5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:2358:x1877696158147584:12345-192.168.206.46@tcp:103:ldlm_bl.0 Request processed in 9362us (9490us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710855.104989:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 42 00000100:00100000:3.0:1790710855.111156:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710855.111350:0:6703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158147712 00000100:00100000:2.0:1790710855.111360:0:6703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158147712 00002000:00100000:2.0:1790710855.111406:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9c51ff1aca80 x1877696158147712/t0(0) o4->0ec73bd1-726e-4dc0-8edd-807d3f973d65@192.168.206.46@tcp:356/0 lens 504/0 e 0 to 0 dl 1790710866 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790710855.111418:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c51ff1aca80 with x1877696158147712 ext(0->8) 00002000:00010000:2.0:1790710855.111432:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c51ff1aca80 00000100:00100000:2.0:1790710855.111455:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 0 00000100:00100000:2.0:1790710855.111463:0:6703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff1aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:2359:x1877696158147712:12345-192.168.206.46@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1790710855.112458:0:6703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff1aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+8:2359:x1877696158147712:12345-192.168.206.46@tcp:4:lhsmtool_posix.0 Request processed in 990us (1332us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1790710855.112468:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 0 00002000:00100000:2.0:1790710855.112487:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9c51ff1aca80 x1877696158147712/t4294967302(0) o4->0ec73bd1-726e-4dc0-8edd-807d3f973d65@192.168.206.46@tcp:356/0 lens 504/448 e 0 to 0 dl 1790710866 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790710855.112496:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c51ff1aca80 with x1877696158147712 ext(0->8) 00002000:00010000:2.0:1790710855.112501:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c51ff1aca80 00000100:00100000:2.0:1790710855.122559:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710855.123325:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158147840 00000100:00100000:3.0:1790710855.123336:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158147840 00000100:00100000:3.0:1790710855.123393:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 80 00000100:00100000:3.0:1790710855.123402:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff60e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+41:10428:x1877696158147840:12345-192.168.206.46@tcp:44:lhsmtool_posix.0 00010000:00010000:1.0:1790710855.183453:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790710855.198374:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff60e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+41:10428:x1877696158147840:12345-192.168.206.46@tcp:44:lhsmtool_posix.0 Request processed in 74963us (75814us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710855.198386:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 80 00000001:00080000:0.0:1790710855.198418:0:5867:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967350 is committed 00000001:00080000:0.0:1790710855.198442:0:5867:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967352 is committed 00000001:00080000:0.0:1790710855.198476:0:5867:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:0.0:1790710855.198481:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:0.0:1790710855.198494:0:5867:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:0.0:1790710855.198843:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:0.0:1790710855.198853:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1790710855.198866:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1877696177045120:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1790710855.198908:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710855.198961:0:6696:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177045120 00000100:00100000:0.0:1790710855.198968:0:6696:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177045120 00000100:00100000:0.0:1790710855.199006:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790710855.199013:0:6696:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1877696177045120:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1790710855.199268:0:6696:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1790710855.199271:0:6696:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1790710854 00002000:00010000:0.0:1790710855.199274:0:6696:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1790710855.199276:0:6696:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1790710854 -> 1790710854 00002000:00010000:0.0:1790710855.199278:0:6696:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1790710855.199310:0:6696:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1877696177045120:12345-0@lo:2:osp-syn-1-0.0 Request processed in 298us (401us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1790710855.199317:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1790710855.199334:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1790710855.199362:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c51f4d5c380/2, rc 0, transno 4294967303 00000100:00100000:0.0:1790710855.199368:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1877696177045120:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1790710855.206972:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710855.207167:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158147968 00000100:00100000:1.0:1790710855.207177:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158147968 00000100:00100000:1.0:1790710855.207237:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 30 00000100:00100000:1.0:1790710855.207248:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff60f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+8:2358:x1877696158147968:12345-192.168.206.46@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1790710855.273786:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff60f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+8:2358:x1877696158147968:12345-192.168.206.46@tcp:16:lhsmtool_posix.0 Request processed in 66528us (66810us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710855.273799:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 30 00000001:00080000:0.0:1790710855.273906:0:7643:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:0.0:1790710855.273917:0:7643:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:0.0:1790710855.276074:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710855.276287:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158148224 00000100:00100000:1.0:1790710855.276298:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158148224 00000100:00100000:1.0:1790710855.276393:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 81 00000100:00100000:1.0:1790710855.276405:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+13:10428:x1877696158148224:12345-192.168.206.46@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790710855.276462:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790710855.276493:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645800/0xcbad34b2815712c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000504 expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710855.276513:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c51c2c2eb00) 00010000:00010000:1.0:1790710855.276518:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790710855.276553:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481a00/0xcbad34b2815712dd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710855.276569:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481a00/0xcbad34b2815712dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710855.276580:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481a00/0xcbad34b2815712dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790710855.276822:0:5847:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000291fed4c reply state 000000004257279f transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481a00/0xcbad34b2815712dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710855.276833:0:5847:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790710855.276920:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+14:10428:x1877696158148224:12345-192.168.206.46@tcp:36:lhsmtool_posix.0 Request processed in 517us (854us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1790710855.276939:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 81 00010000:00010000:0.0:1790710855.285537:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481a00/0xcbad34b2815712dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710855.285554:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481a00/0xcbad34b2815712dd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710855.285562:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481a00/0xcbad34b2815712dd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710855.285567:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c6481a00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1790710855.285572:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481a00/0xcbad34b2815712dd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710855.285580:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481a00/0xcbad34b2815712dd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710855.285595:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c51c2c2eb00) 00010000:00010000:0.0:1790710855.285598:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790710855.285603:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481a00/0xcbad34b2815712dd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710855.285609:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481a00/0xcbad34b2815712dd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710855.286756:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710855.286987:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158148352 00000100:00100000:3.0:1790710855.286997:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158148352 00000100:00100000:3.0:1790710855.287049:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 31 00000100:00100000:3.0:1790710855.287058:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:2358:x1877696158148352:12345-192.168.206.46@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1790710855.287640:0:6697:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1790710855.287644:0:6697:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1790710854 -> 1790710853 00002000:00010000:3.0:1790710855.287647:0:6697:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1790710851 00002000:00010000:3.0:1790710855.287649:0:6697:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1790710854 -> 1790710853 00002000:00010000:3.0:1790710855.287651:0:6697:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1790710855.287725:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+7:2358:x1877696158148352:12345-192.168.206.46@tcp:2:lhsmtool_posix.0 Request processed in 666us (975us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1790710855.287734:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 31 00000100:00100000:1.0:1790710855.291780:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710855.291910:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158148608 00000100:00100000:2.0:1790710855.291924:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158148608 00000100:00100000:2.0:1790710855.291989:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 82 00000100:00100000:2.0:1790710855.291999:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c6529180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+13:10428:x1877696158148608:12345-192.168.206.46@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1790710855.292062:0:8060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b2815712e4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710855.292080:0:8060:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216be00/0xcbad34b2815712a5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570004f6 expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710855.292089:0:8060:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b2815712e4 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710855.292123:0:8060:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216be00/0xcbad34b2815712a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.46@tcp remote: 0x566877b0570004f6 expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710855.292182:0:8060:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216be00/0xcbad34b2815712a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570004f6 expref: 13 pid: 5845 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710855.292533:0:8060:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51ff60e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8060:1877696177045248:192.168.206.46@tcp:104: 00000100:00100000:2.0:1790710855.292624:0:8060:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c2b58480 going to sleep for 11 seconds 00000100:00100000:2.0:1790710855.307322:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710855.307464:0:8449:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158148736 00000100:00100000:1.0:1790710855.307481:0:8449:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158148736 00010000:00010000:1.0:1790710855.307541:0:8449:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216be00/0xcbad34b2815712a5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570004f6 expref: 14 pid: 5845 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710855.307596:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 43 00000100:00100000:1.0:1790710855.307609:0:8449:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff60ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+14:2359:x1877696158148736:12345-192.168.206.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790710855.307632:0:8449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790710855.307640:0:8449:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216be00/0xcbad34b2815712a5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570004f6 expref: 14 pid: 5845 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710855.307656:0:8449:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216be00/0xcbad34b2815712a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570004f6 expref: 14 pid: 5845 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710855.307683:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c51c2c2eb00) 00010000:00010000:1.0:1790710855.307690:0:8449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b2815712e4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710855.307701:0:8449:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b2815712e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710855.307711:0:8449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b2815712e4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710855.307732:0:8449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790710855.307808:0:8449:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff60ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+14:2359:x1877696158148736:12345-192.168.206.46@tcp:103:ldlm_bl.0 Request processed in 202us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710855.307848:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 43 00010000:00010000:0.0:1790710855.311161:0:8060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216be00/0xcbad34b2815712a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570004f6 expref: 13 pid: 5845 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710855.311188:0:8060:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51ff60e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8060:1877696177045248:192.168.206.46@tcp:104: 00010000:00010000:0.0:1790710855.311224:0:8060:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b2815712e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710855.311250:0:8060:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b2815712e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710855.311257:0:8060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b2815712e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710855.311930:0:8060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b2815712e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710855.311941:0:8060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b2815712e4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710855.311948:0:8060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b2815712e4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710855.311954:0:8060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c8047a00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1790710855.311959:0:8060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b2815712e4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710855.311967:0:8060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b2815712e4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710855.311985:0:8060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c51c2c2eb00) 00010000:00010000:0.0:1790710855.311989:0:8060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1790710855.311993:0:8060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b2815712e4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710855.311999:0:8060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b2815712e4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710855.312202:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c6529180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+12:10428:x1877696158148608:12345-192.168.206.46@tcp:55:lhsmtool_posix.0 Request processed in 20202us (20433us total) trans 0 rc -22/-22 00000100:00100000:0.0:1790710855.312231:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 82 00000100:00100000:2.0:1790710855.319593:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710855.319682:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158148864 00000100:00100000:0.0:1790710855.319692:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158148864 00000100:00100000:0.0:1790710855.319743:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 32 00000100:00100000:0.0:1790710855.319752:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff60c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+7:2358:x1877696158148864:12345-192.168.206.46@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1790710855.319791:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008cdb18a6/0xcbad34b2815712eb lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710855.319952:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000aa52bd29/0xcbad34b2815712d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.46@tcp remote: 0x566877b057000512 expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710855.319962:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790710855.319966:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790710855.319971:0:6698:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008cdb18a6/0xcbad34b2815712eb lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710855.320023:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000aa52bd29/0xcbad34b2815712d6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.46@tcp remote: 0x566877b057000512 expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710855.320037:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000aa52bd29/0xcbad34b2815712d6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.46@tcp remote: 0x566877b057000512 expref: 7 pid: 6698 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710855.320052:0:6698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51d03ece00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1877696177045376:192.168.206.46@tcp:104: 00000100:00100000:0.0:1790710855.320244:0:6698:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f9b2dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790710855.333709:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710855.334169:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158148992 00000100:00100000:2.0:1790710855.334179:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158148992 00010000:00010000:2.0:1790710855.334230:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000aa52bd29/0xcbad34b2815712d6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.46@tcp remote: 0x566877b057000512 expref: 8 pid: 6698 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710855.334266:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 44 00000100:00100000:2.0:1790710855.334284:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff1af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+8:2359:x1877696158148992:12345-192.168.206.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790710855.334298:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790710855.334319:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000aa52bd29/0xcbad34b2815712d6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.46@tcp remote: 0x566877b057000512 expref: 8 pid: 6698 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710855.334332:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000aa52bd29/0xcbad34b2815712d6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.46@tcp remote: 0x566877b057000512 expref: 8 pid: 6698 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710855.334356:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790710855.334360:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790710855.334366:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008cdb18a6/0xcbad34b2815712eb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710855.334394:0:5831:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008cdb18a6/0xcbad34b2815712eb lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710855.334415:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790710855.334473:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff1af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+8:2359:x1877696158148992:12345-192.168.206.46@tcp:103:ldlm_bl.0 Request processed in 190us (772us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710855.334480:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 44 00010000:00010000:0.0:1790710855.334627:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa52bd29/0xcbad34b2815712d6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.46@tcp remote: 0x566877b057000512 expref: 7 pid: 6698 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710855.334647:0:6698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51d03ece00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1877696177045376:192.168.206.46@tcp:104: 00010000:00010000:0.0:1790710855.334666:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008cdb18a6/0xcbad34b2815712eb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710855.334677:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008cdb18a6/0xcbad34b2815712eb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710855.334685:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008cdb18a6/0xcbad34b2815712eb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710855.334708:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008cdb18a6/0xcbad34b2815712eb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710855.334716:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008cdb18a6/0xcbad34b2815712eb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710855.334723:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008cdb18a6/0xcbad34b2815712eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710855.334730:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c0030200 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:0.0:1790710855.334733:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008cdb18a6/0xcbad34b2815712eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710855.334742:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008cdb18a6/0xcbad34b2815712eb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710855.334761:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008cdb18a6/0xcbad34b2815712eb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710855.334770:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008cdb18a6/0xcbad34b2815712eb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710855.334833:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff60c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:2358:x1877696158148864:12345-192.168.206.46@tcp:1:lhsmtool_posix.0 Request processed in 15081us (15249us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710855.334839:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 32 00000100:00100000:2.0:1790710855.336986:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710855.337051:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158149248 00000100:00100000:0.0:1790710855.337071:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158149248 00000100:00100000:0.0:1790710855.337120:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 83 00000100:00100000:0.0:1790710855.337152:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff60dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+12:10428:x1877696158149248:12345-192.168.206.46@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1790710855.337234:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030c00/0xcbad34b2815712f2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710855.337250:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030c00/0xcbad34b2815712f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710855.337264:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030c00/0xcbad34b2815712f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710855.337693:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b2815712f9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710855.337706:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1644a00/0xcbad34b2815712b3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570004fd expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710855.337732:0:5846:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b2815712f9 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710855.337764:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1644a00/0xcbad34b2815712b3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.46@tcp remote: 0x566877b0570004fd expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710855.337778:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1644a00/0xcbad34b2815712b3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570004fd expref: 13 pid: 5845 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710855.337792:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51d03ece00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1877696177045504:192.168.206.46@tcp:104: 00000100:00100000:0.0:1790710855.338003:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f9b2dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790710855.343055:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51d03ece00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1877696177045504:192.168.206.46@tcp:104: 00010000:00010000:0.0:1790710855.343094:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b2815712f9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710855.346038:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710855.346342:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158149376 00000100:00100000:3.0:1790710855.346352:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158149376 00010000:00010000:3.0:1790710855.346390:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1644a00/0xcbad34b2815712b3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570004fd expref: 14 pid: 5845 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710855.346432:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 45 00000100:00100000:3.0:1790710855.346442:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff60e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+14:2358:x1877696158149376:12345-192.168.206.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790710855.346457:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790710855.346464:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1644a00/0xcbad34b2815712b3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570004fd expref: 14 pid: 5845 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710855.346476:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1644a00/0xcbad34b2815712b3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570004fd expref: 14 pid: 5845 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710855.346498:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1644a00/0xcbad34b2815712b3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570004fd expref: 14 pid: 5845 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710855.346530:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c51c2c2eb00) 00010000:00010000:3.0:1790710855.346537:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b2815712f9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710855.346548:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b2815712f9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710855.346556:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b2815712f9 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710855.346585:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790710855.346643:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff60e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+13:2358:x1877696158149376:12345-192.168.206.46@tcp:103:ldlm_bl.0 Request processed in 202us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710855.346651:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 45 00010000:00010000:0.0:1790710855.346721:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b2815712f9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710855.346728:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b2815712f9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790710855.346877:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:0.0:1790710855.347004:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:0.0:1790710855.347043:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:0.0:1790710855.347187:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51d03ece00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5846:1877696177045632:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1790710855.347247:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710855.347271:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51d8a96c00 going to sleep for 11 seconds 00000100:00100000:1.0:1790710855.347654:0:5851:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177045632 00000100:00100000:1.0:1790710855.347661:0:5851:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177045632 00000100:00100000:1.0:1790710855.347703:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790710855.347712:0:5851:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d03efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5846:x1877696177045632:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1790710855.347789:0:5851:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d03efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5846:x1877696177045632:12345-0@lo:1000:mdt00_001.0 Request processed in 78us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710855.347796:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790710855.347845:0:5846:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:1.0:1790710855.347851:0:5846:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c51f4d5c380, transno 4294967303 00000100:00100000:1.0:1790710855.347864:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51d03ece00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5846:1877696177045632:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1790710855.348459:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:1.0:1790710855.348523:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c6529880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5846:1877696177045760:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1790710855.348562:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710855.348583:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f4ecf9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790710855.348822:0:5851:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177045760 00000100:00100000:1.0:1790710855.348828:0:5851:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177045760 00000100:00100000:1.0:1790710855.348853:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790710855.348860:0:5851:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c6528380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5846:x1877696177045760:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1790710855.349018:0:5851:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c6528380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5846:x1877696177045760:12345-0@lo:1000:mdt00_001.0 Request processed in 157us (455us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1790710855.349025:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790710855.349063:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c6529880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5846:1877696177045760:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1790710855.349093:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b2815712f9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710855.349112:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b2815712f9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710855.349120:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b2815712f9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710855.349149:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c0030000 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1790710855.349153:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b2815712f9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710855.349162:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b2815712f9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710855.349178:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c51c2c2eb00) 00010000:00010000:1.0:1790710855.349181:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790710855.349185:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b2815712f9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710855.349190:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b2815712f9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710855.349236:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b28157122e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710855.349243:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b28157122e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710855.349249:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b28157122e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710855.349253:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c6480e00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1790710855.349263:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b28157122e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710855.349269:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b28157122e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710855.349277:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c51d8e33d00) 00010000:00010000:1.0:1790710855.349279:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790710855.349282:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b28157122e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710855.349287:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b28157122e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710855.349307:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571300 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710855.349320:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b28157124a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570004e1 expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710855.349327:0:5846:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571300 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710855.349353:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b28157124a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.46@tcp remote: 0x566877b0570004e1 expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710855.349367:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b28157124a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570004e1 expref: 16 pid: 5847 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710855.349378:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c652ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1877696177045888:192.168.206.46@tcp:104: 00000100:00100000:1.0:1790710855.349428:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f4ecf9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790710855.363493:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710855.364305:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158149504 00000100:00100000:0.0:1790710855.364315:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158149504 00010000:00010000:0.0:1790710855.364354:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b28157124a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570004e1 expref: 17 pid: 5847 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710855.364395:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 46 00000100:00100000:0.0:1790710855.364404:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff60fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+17:2359:x1877696158149504:12345-192.168.206.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790710855.364419:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790710855.364426:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b28157124a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570004e1 expref: 17 pid: 5847 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710855.364438:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b28157124a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570004e1 expref: 17 pid: 5847 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710855.364460:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c51d8e33d00) 00010000:00010000:0.0:1790710855.364465:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571300 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710855.364475:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571300 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710855.364483:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571300 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710855.364501:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790710855.364549:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff60fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+17:2359:x1877696158149504:12345-192.168.206.46@tcp:103:ldlm_bl.0 Request processed in 146us (1065us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710855.364557:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 46 00010000:00010000:1.0:1790710855.367876:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b28157124a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570004e1 expref: 16 pid: 5847 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710855.367900:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c652ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1877696177045888:192.168.206.46@tcp:104: 00010000:00010000:1.0:1790710855.367922:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571300 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710855.368010:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571300 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710855.368046:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571300 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710855.368071:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571300 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710855.368079:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571300 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710855.368087:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571300 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710855.368093:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c6481000 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1790710855.368098:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571300 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710855.368105:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571300 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710855.368121:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c51d8e33d00) 00010000:00010000:0.0:1790710855.368153:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790710855.368160:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571300 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710855.368167:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571300 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710855.368178:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030c00/0xcbad34b2815712f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710855.368185:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030c00/0xcbad34b2815712f2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710855.368197:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030c00/0xcbad34b2815712f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710855.368203:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c0030c00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1790710855.368206:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030c00/0xcbad34b2815712f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710855.368224:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030c00/0xcbad34b2815712f2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710855.368233:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c51d8e33d00) 00010000:00010000:0.0:1790710855.368236:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790710855.368239:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030c00/0xcbad34b2815712f2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710855.368245:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030c00/0xcbad34b2815712f2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710855.368661:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff60dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+15:10428:x1877696158149248:12345-192.168.206.46@tcp:57:lhsmtool_posix.0 Request processed in 31530us (31678us total) trans 4294967360 rc 0/0 00000100:00100000:0.0:1790710855.368673:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 83 00000020:00080000:0.0:1790710855.368679:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1790710855.369511:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790710855.369516:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790710855.369544:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1790710855.369549:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790710855.374643:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710855.375543:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158149760 00000100:00100000:3.0:1790710855.375560:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158149760 00000100:00100000:3.0:1790710855.375635:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 20 00000100:00100000:3.0:1790710855.375647:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51fa2cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+15:10428:x1877696158149760:12345-192.168.206.46@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1790710855.378395:0:5848:0:(mdd_object.c:4180:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1790710855.378529:0:5848:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:2.0:1790710855.378597:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b281571307 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710855.378615:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b281571307 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710855.378625:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b281571307 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710855.378634:0:5848:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b281571307 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710855.378640:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b281571307 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710855.378645:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b281571307 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710855.378670:0:5848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1790710855.378781:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51fa2cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+17:10428:x1877696158149760:12345-192.168.206.46@tcp:35:lhsmtool_posix.0 Request processed in 3132us (4141us total) trans 4294967362 rc 0/0 00010000:00010000:0.0:1790710855.378886:0:8509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790710855.378893:0:8509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b281571307 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710855.378900:0:8509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c8046e00 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:0.0:1790710855.378904:0:8509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b281571307 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710855.378922:0:8509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b281571307 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710855.378934:0:8509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c51cca25a00) 00010000:00010000:0.0:1790710855.378937:0:8509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1790710855.378942:0:8509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b281571307 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710855.378947:0:8509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b281571307 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710855.378965:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790710855.378967:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790710855.378968:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790710855.379351:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 20 00000020:00080000:2.0:1790710855.379358:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1790710855.441487:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51ff1ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d27fc27-b651-404a-bd8c-b798806fb18a:3310:1877696177046016:0@lo:400:kworker.0 00000100:00100000:3.0:1790710855.441610:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710855.441952:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c652ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1877696177046528:0@lo:400:kworker.0 00000100:00100000:3.0:1790710855.442000:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710855.442054:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790710855.442239:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c652dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1877696177046400:0@lo:400:kworker.0 00000100:00100000:3.0:1790710855.442316:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710855.442496:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177046016 00000100:00100000:0.0:1790710855.442509:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177046016 00000100:00100000:0.0:1790710855.442583:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1790710855.442595:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ee788450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+19:3310:x1877696177046016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790710855.442670:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ee788450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+19:3310:x1877696177046016:12345-0@lo:400:kworker.0 Request processed in 77us (1064us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710855.442678:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1790710855.442990:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51ff1ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1877696177046144:0@lo:400:kworker.0 00000100:00100000:3.0:1790710855.443171:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710855.443204:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790710855.443224:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f3e74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1877696177046272:0@lo:400:kworker.0 00000100:00100000:3.0:1790710855.443270:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710855.443520:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177046528 00000100:00100000:3.0:1790710855.443527:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177046528 00000100:00100000:3.0:1790710855.443580:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177046144 00000100:00100000:3.0:1790710855.443583:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177046144 00000100:00100000:3.0:1790710855.443595:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177046272 00000100:00100000:3.0:1790710855.443597:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177046272 00000100:00100000:3.0:1790710855.443611:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1790710855.443620:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c652f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1877696177046528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790710855.443673:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c652f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1877696177046528:12345-0@lo:400:kworker.0 Request processed in 54us (1678us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710855.443681:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1790710855.443716:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1790710855.443742:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9764e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1877696177046144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790710855.443801:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1790710855.443812:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9767b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1877696177046272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790710855.443916:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9764e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1877696177046144:12345-0@lo:400:kworker.0 Request processed in 183us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710855.443925:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1790710855.444013:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9767b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1877696177046272:12345-0@lo:400:kworker.0 Request processed in 201us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710855.444020:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:3.0:1790710855.444046:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790710855.444458:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f3e74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1877696177046272:0@lo:400:kworker.0 00000100:00100000:2.0:1790710855.444484:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51ff1ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1877696177046144:0@lo:400:kworker.0 00000100:00100000:2.0:1790710855.444533:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177046400 00000100:00100000:2.0:1790710855.444540:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177046400 00000100:00100000:3.0:1790710855.444553:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51ff1ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d27fc27-b651-404a-bd8c-b798806fb18a:3310:1877696177046016:0@lo:400:kworker.0 00000100:00100000:3.0:1790710855.444569:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c652ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1877696177046528:0@lo:400:kworker.0 00000100:00100000:2.0:1790710855.444736:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1790710855.444745:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9765f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3310:x1877696177046400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790710855.444819:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9765f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3310:x1877696177046400:12345-0@lo:400:kworker.0 Request processed in 75us (2507us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710855.444826:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1790710855.444863:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c652dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1877696177046400:0@lo:400:kworker.0 00000100:00080000:3.0:1790710855.445670:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790710855.944970:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790710855.944993:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51fa2cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1877696177046656:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790710855.945088:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710855.945444:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177046656 00000100:00100000:2.0:1790710855.945453:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177046656 00000100:00100000:2.0:1790710855.945508:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1790710855.945520:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9765500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1877696177046656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790710855.945556:0:6699:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1790710855.945609:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9765500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1877696177046656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710855.945617:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1790710855.945668:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51fa2cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1877696177046656:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1790710856.199324:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790710856.456153:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c652ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1877696177046784:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790710856.456246:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710856.456539:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177046784 00000100:00100000:0.0:1790710856.456547:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177046784 00000100:00100000:0.0:1790710856.456607:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1790710856.456616:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51fa2cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1877696177046784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790710856.456651:0:6699:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790710856.467687:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c652ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1877696177046784:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790710856.472686:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51fa2cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1877696177046784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 16063us (16432us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710856.472708:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1790710856.671097:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710856.671215:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158149888 00000100:00100000:0.0:1790710856.671224:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158149888 00000100:00100000:0.0:1790710856.671272:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 289 00000100:00100000:0.0:1790710856.671282:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ee788850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b75d7a5-152f-4db9-bf19-5fe279a322e3+13:2359:x1877696158149888:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:0.0:1790710856.671366:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ee788850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b75d7a5-152f-4db9-bf19-5fe279a322e3+13:2359:x1877696158149888:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 86us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710856.671374:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 289 00000100:00100000:0.0:1790710856.673226:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710856.673258:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710856.673277:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710856.673299:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710856.673334:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158150144 00000100:00100000:0.0:1790710856.673340:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158150144 00000100:00100000:0.0:1790710856.673384:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158150272 00000100:00100000:0.0:1790710856.673387:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158150272 00000100:00100000:0.0:1790710856.673403:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 72 00000100:00100000:0.0:1790710856.673411:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d03eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+5:2359:x1877696158150144:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:0.0:1790710856.673467:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d03eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+5:2359:x1877696158150144:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 56us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710856.673474:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 72 00000100:00100000:0.0:1790710856.673490:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 73 00000100:00100000:0.0:1790710856.673497:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d03ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:2359:x1877696158150272:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:0.0:1790710856.673522:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d03ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:2359:x1877696158150272:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 27us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710856.673540:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 73 00000100:00100000:0.0:1790710856.673560:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158150016 00000100:00100000:0.0:1790710856.673564:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158150016 00000100:00100000:0.0:1790710856.673586:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158150400 00000100:00100000:0.0:1790710856.673589:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158150400 00000100:00100000:0.0:1790710856.673609:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 137 00000100:00100000:0.0:1790710856.673616:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d03ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+17:2359:x1877696158150016:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:0.0:1790710856.673650:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d03ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+17:2359:x1877696158150016:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 34us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710856.673656:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 137 00000100:00100000:0.0:1790710856.673668:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 138 00000100:00100000:0.0:1790710856.673674:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d03ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1b59f23d-9a5c-439d-bd4a-453bf2315b97+5:2359:x1877696158150400:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:0.0:1790710856.673695:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d03ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1b59f23d-9a5c-439d-bd4a-453bf2315b97+5:2359:x1877696158150400:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 22us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710856.673701:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 138 00000100:00080000:0.0:1790710856.673719:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790710856.673723:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790710856.673724:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:3.0:1790710856.947199:0:12043:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790710856.947217:0:12043:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790710856.947525:0:12043:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1790710856.947531:0:12043:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790710857.078729:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710857.078890:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158150656 00000100:00100000:3.0:1790710857.078900:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158150656 00000100:00100000:3.0:1790710857.079017:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 84 00000100:00100000:3.0:1790710857.079027:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51fa2cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+17:10447:x1877696158150656:12345-192.168.206.46@tcp:101:lfs.0 00010000:00010000:3.0:1790710857.079056:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790710857.079075:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1644a00/0xcbad34b28157130e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b057000519 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.079209:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645400/0xcbad34b281571315 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.079225:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645400/0xcbad34b281571315 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.079238:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645400/0xcbad34b281571315 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790710857.079251:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000100:00080000:1.0:1790710857.079361:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1790710857.079362:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1644a00/0xcbad34b28157130e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000519 expref: 20 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.079383:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645400/0xcbad34b281571315 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000519 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.079401:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c51c2c2ee00) 00010000:00010000:3.0:1790710857.079404:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790710857.079407:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c1645400, rc 0) 00000100:00100000:3.0:1790710857.079468:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51fa2cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+19:10447:x1877696158150656:12345-192.168.206.46@tcp:101:lfs.0 Request processed in 442us (749us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1790710857.079485:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 84 00000100:00100000:1.0:1790710857.084257:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710857.084316:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158150784 00000100:00100000:3.0:1790710857.084325:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158150784 00000100:00100000:3.0:1790710857.084407:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 85 00000100:00100000:3.0:1790710857.084417:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c652ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+19:10447:x1877696158150784:12345-192.168.206.46@tcp:34:lfs.0 00010000:00010000:3.0:1790710857.084499:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645000/0xcbad34b281571323 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.084516:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645000/0xcbad34b281571323 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.084526:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645000/0xcbad34b281571323 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.084538:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b28157132a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.084545:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b28157132a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.084551:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b28157132a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.084807:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281571331 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.084821:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281571331 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.084828:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281571331 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790710857.084866:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281571331 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.084878:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645000/0xcbad34b281571323 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.084886:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645000/0xcbad34b281571323 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.084893:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645000/0xcbad34b281571323 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.084899:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c1645000 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1790710857.084904:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645000/0xcbad34b281571323 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.084911:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645000/0xcbad34b281571323 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.084924:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c51c2c2ee00) 00010000:00010000:3.0:1790710857.084928:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790710857.084932:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645000/0xcbad34b281571323 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.084938:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645000/0xcbad34b281571323 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.084969:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b28157132a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.084975:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b28157132a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.084981:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b28157132a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.084987:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c1645c00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1790710857.084991:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b28157132a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.084998:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b28157132a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.085005:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c51c2c2e200) 00010000:00010000:3.0:1790710857.085008:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790710857.085011:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b28157132a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.085018:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b28157132a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.085032:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281571331 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.085039:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281571331 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.085045:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281571331 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.085057:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c1645200 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1790710857.085060:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281571331 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.085066:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281571331 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.085074:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c51c2c2e100) 00010000:00010000:3.0:1790710857.085077:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790710857.085079:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281571331 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.085237:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281571331 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710857.085319:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c652ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+19:10447:x1877696158150784:12345-192.168.206.46@tcp:34:lfs.0 Request processed in 901us (1069us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710857.085327:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 85 00000100:00100000:1.0:1790710857.154869:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710857.154955:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158151040 00000100:00100000:2.0:1790710857.154964:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158151040 00000100:00100000:2.0:1790710857.155020:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 86 00000100:00100000:2.0:1790710857.155028:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c6529500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+19:10450:x1877696158151040:12345-192.168.206.46@tcp:101:lfs.0 00010000:00010000:2.0:1790710857.155048:0:8060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790710857.155079:0:8060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b281571338 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b057000520 expref: -99 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710857.155181:0:8060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b28157133f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710857.155207:0:8060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b28157133f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710857.155219:0:8060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b28157133f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710857.155252:0:8060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b281571346 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710857.155260:0:8060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b281571346 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710857.155265:0:8060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b281571346 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710857.155553:0:8060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047000/0xcbad34b28157134d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710857.155562:0:8060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047000/0xcbad34b28157134d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710857.155569:0:8060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047000/0xcbad34b28157134d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790710857.155579:0:8060:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1790710857.155673:0:8060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b28157133f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710857.155681:0:8060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b28157133f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710857.155688:0:8060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b28157133f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710857.155694:0:8060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c8046e00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1790710857.155698:0:8060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b28157133f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710857.155714:0:8060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b28157133f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710857.155725:0:8060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c51c2c2ee00) 00010000:00010000:2.0:1790710857.155728:0:8060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790710857.155732:0:8060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b28157133f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710857.155739:0:8060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b28157133f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710857.155751:0:8060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b281571346 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710857.155757:0:8060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b281571346 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710857.155762:0:8060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b281571346 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710857.155767:0:8060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c8046800 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1790710857.155770:0:8060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b281571346 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710857.155775:0:8060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b281571346 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710857.155781:0:8060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c51cca25600) 00010000:00010000:2.0:1790710857.155784:0:8060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790710857.155787:0:8060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b281571346 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710857.155801:0:8060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b281571346 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710857.155838:0:8060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b281571338 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000520 expref: 22 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710857.155864:0:8060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047000/0xcbad34b28157134d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000520 expref: 21 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710857.155871:0:8060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c51cca25000) 00010000:00010000:2.0:1790710857.155873:0:8060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790710857.155876:0:8060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c8047000, rc 0) 00000100:00100000:2.0:1790710857.155934:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c6529500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+21:10450:x1877696158151040:12345-192.168.206.46@tcp:101:lfs.0 Request processed in 906us (1073us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1790710857.155941:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 86 00000100:00100000:2.0:1790710857.160252:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710857.160307:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158151168 00000100:00100000:1.0:1790710857.160317:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158151168 00000100:00100000:0.0:1790710857.160567:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 87 00000100:00100000:0.0:1790710857.160577:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51fa2cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+21:10450:x1877696158151168:12345-192.168.206.46@tcp:54:lfs.0 00010000:00010000:0.0:1790710857.160655:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031800/0xcbad34b28157135b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710857.160673:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031800/0xcbad34b28157135b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710857.160701:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031800/0xcbad34b28157135b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710857.160726:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031800/0xcbad34b28157135b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710857.160733:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031800/0xcbad34b28157135b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710857.160740:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031800/0xcbad34b28157135b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710857.160746:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c0031800 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1790710857.160750:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031800/0xcbad34b28157135b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710857.160758:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031800/0xcbad34b28157135b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710857.160769:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c51cca25000) 00010000:00010000:0.0:1790710857.160773:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790710857.160778:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031800/0xcbad34b28157135b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710857.160784:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031800/0xcbad34b28157135b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710857.160868:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51fa2cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+21:10450:x1877696158151168:12345-192.168.206.46@tcp:54:lfs.0 Request processed in 291us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710857.160875:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 87 00000100:00100000:1.0:1790710857.165707:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710857.166259:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158151424 00000100:00100000:0.0:1790710857.166284:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158151424 00000100:00100000:0.0:1790710857.167014:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 21 00000100:00100000:0.0:1790710857.167029:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d6261850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+21:10450:x1877696158151424:12345-192.168.206.46@tcp:35:lfs.0 00000100:00100000:0.0:1790710857.168959:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d6261850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+22:10450:x1877696158151424:12345-192.168.206.46@tcp:35:lfs.0 Request processed in 284us (1611us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1790710857.168977:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 21 00000100:00100000:1.0:1790710857.222708:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710857.222900:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158151680 00000100:00100000:3.0:1790710857.222911:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158151680 00000100:00100000:3.0:1790710857.222964:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 88 00000100:00100000:3.0:1790710857.222973:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c6529f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+22:9971:x1877696158151680:12345-192.168.206.46@tcp:101:bash.0 00010000:00010000:3.0:1790710857.222997:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790710857.223014:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281571362 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b057000527 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.223115:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b281571369 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.223177:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047000/0xcbad34b28157134d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000520 expref: 23 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.223187:0:5845:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b281571369 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.223228:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047000/0xcbad34b28157134d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.46@tcp remote: 0x566877b057000520 expref: 23 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.223241:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047000/0xcbad34b28157134d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000520 expref: 23 pid: 8060 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710857.223254:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9764a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1877696177046912:192.168.206.46@tcp:104: 00010000:00010000:1.0:1790710857.223310:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790710857.223352:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c2b58900 going to sleep for 11 seconds 00000100:00100000:3.0:1790710857.225967:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9764a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1877696177046912:192.168.206.46@tcp:104: 00010000:00010000:3.0:1790710857.225993:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b281571369 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710857.229296:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710857.232253:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158151808 00000100:00100000:3.0:1790710857.232269:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158151808 00010000:00010000:3.0:1790710857.232439:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047000/0xcbad34b28157134d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000520 expref: 24 pid: 8060 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710857.232482:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 47 00000100:00100000:3.0:1790710857.232493:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c652aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+24:2358:x1877696158151808:12345-192.168.206.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790710857.232508:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790710857.232526:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047000/0xcbad34b28157134d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000520 expref: 24 pid: 8060 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.232549:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047000/0xcbad34b28157134d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000520 expref: 24 pid: 8060 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.232571:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047000/0xcbad34b28157134d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000520 expref: 24 pid: 8060 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.232587:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c51cca25000) 00010000:00010000:3.0:1790710857.232592:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b281571369 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.232601:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b281571369 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.232608:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b281571369 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.232850:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790710857.232914:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c652aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+23:2358:x1877696158151808:12345-192.168.206.46@tcp:103:ldlm_bl.0 Request processed in 422us (3627us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710857.232921:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 47 00010000:00010000:0.0:1790710857.234048:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b281571369 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710857.234716:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b281571369 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790710857.234741:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1790710857.234904:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281571362 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000527 expref: 24 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710857.234925:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b281571369 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000527 expref: 23 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710857.234934:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c51cca25000) 00010000:00010000:0.0:1790710857.234937:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790710857.234940:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c1645c00, rc 0) 00000100:00100000:0.0:1790710857.235280:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c6529f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+23:9971:x1877696158151680:12345-192.168.206.46@tcp:101:bash.0 Request processed in 12306us (12579us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1790710857.235289:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 88 00000100:00100000:1.0:1790710857.241771:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710857.241975:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158152064 00000100:00100000:0.0:1790710857.241986:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158152064 00000100:00100000:0.0:1790710857.242044:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 89 00000100:00100000:0.0:1790710857.242068:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c6528700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+23:9971:x1877696158152064:12345-192.168.206.46@tcp:36:bash.0 00010000:00010000:0.0:1790710857.242555:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031600/0xcbad34b281571377 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710857.242573:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031600/0xcbad34b281571377 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710857.242585:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031600/0xcbad34b281571377 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790710857.242714:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:0.0:1790710857.242741:0:5846:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000004031e3e1 reply state 00000000dcd74f31 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031600/0xcbad34b281571377 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710857.242750:0:5846:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1790710857.242795:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:0.0:1790710857.242943:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c6528700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+27:9971:x1877696158152064:12345-192.168.206.46@tcp:36:bash.0 Request processed in 876us (1179us total) trans 4294967369 rc 0/0 00000100:00100000:0.0:1790710857.242950:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 89 00000020:00080000:0.0:1790710857.242954:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1790710857.248233:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031600/0xcbad34b281571377 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.248249:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031600/0xcbad34b281571377 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.248257:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031600/0xcbad34b281571377 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.248280:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c0031600 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1790710857.248284:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031600/0xcbad34b281571377 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.248292:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031600/0xcbad34b281571377 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.248308:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c51cca25000) 00010000:00010000:3.0:1790710857.248311:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790710857.248316:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031600/0xcbad34b281571377 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.248322:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031600/0xcbad34b281571377 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710857.253432:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710857.253558:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158152192 00000100:00100000:0.0:1790710857.253568:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158152192 00000100:00100000:0.0:1790710857.253804:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 90 00000100:00100000:0.0:1790710857.253816:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+26:9971:x1877696158152192:12345-192.168.206.46@tcp:101:bash.0 00010000:00010000:0.0:1790710857.253842:0:8060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790710857.253861:0:8060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031a00/0xcbad34b28157137e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b05700052e expref: -99 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710857.253920:0:8060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031a00/0xcbad34b28157137e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700052e expref: 27 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710857.253954:0:8060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031a00/0xcbad34b28157137e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700052e expref: 27 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710857.253975:0:8060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c51cca25000) 00010000:00010000:0.0:1790710857.253979:0:8060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790710857.253982:0:8060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c0031a00, rc 0) 00000100:00100000:0.0:1790710857.254185:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+27:9971:x1877696158152192:12345-192.168.206.46@tcp:101:bash.0 Request processed in 237us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710857.256283:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 90 00000100:00100000:1.0:1790710857.260101:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710857.260323:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158152320 00000100:00100000:0.0:1790710857.260333:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158152320 00000100:00100000:0.0:1790710857.260390:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 33 00000100:00100000:0.0:1790710857.260400:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:9971:x1877696158152320:12345-192.168.206.46@tcp:101:bash.0 00010000:00010000:0.0:1790710857.260419:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790710857.260439:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008cdb18a6/0xcbad34b281571385 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b057000535 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790710857.260468:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6abc1445, atime: 0x6abc1443, ctime: 0x6abc1445, blocks: 0xb 00010000:00010000:0.0:1790710857.260488:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=334s v=(0 0) 00010000:00010000:0.0:1790710857.260492:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790710857.260500:0:6698:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008cdb18a6/0xcbad34b281571385 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.46@tcp remote: 0x566877b057000535 expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710857.260517:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008cdb18a6/0xcbad34b281571385 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.46@tcp remote: 0x566877b057000535 expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710857.260547:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c0030200, rc 0) 00000100:00100000:0.0:1790710857.260610:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+7:9971:x1877696158152320:12345-192.168.206.46@tcp:101:bash.0 Request processed in 210us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710857.260617:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 33 00000100:00100000:1.0:1790710857.263255:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710857.263341:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158152448 00000100:00100000:2.0:1790710857.263350:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158152448 00002000:00010000:2.0:1790710857.263389:0:6701:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:2.0:1790710857.263393:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c51c75dd880 with x1877696158152448 ext(0->18446744073709551615) 00002000:00010000:2.0:1790710857.263404:0:6701:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c51c75dd880. 00000100:00100000:2.0:1790710857.263436:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 1 00000100:00100000:2.0:1790710857.263445:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c75dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+7:2359:x1877696158152448:12345-192.168.206.46@tcp:10:bash.0 00002000:00010000:2.0:1790710857.263718:0:6701:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1790710857.263722:0:6701:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1790710853 -> 1790710856 00002000:00010000:2.0:1790710857.263725:0:6701:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1790710851 -> 1790710851 00002000:00010000:2.0:1790710857.263740:0:6701:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1790710853 -> 1790710856 00002000:00010000:2.0:1790710857.263742:0:6701:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1790710857.263808:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c75dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+8:2359:x1877696158152448:12345-192.168.206.46@tcp:10:bash.0 Request processed in 363us (560us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1790710857.263817:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 1 00002000:00010000:2.0:1790710857.263820:0:6701:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:2.0:1790710857.263823:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c51c75dd880 with x1877696158152448 ext(0->18446744073709551615) 00002000:00010000:2.0:1790710857.263838:0:6701:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c51c75dd880. 00000100:00100000:1.0:1790710857.342246:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710857.342332:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158152576 00000100:00100000:3.0:1790710857.342342:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158152576 00000100:00100000:3.0:1790710857.342398:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 91 00000100:00100000:3.0:1790710857.342408:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c75dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+27:10464:x1877696158152576:12345-192.168.206.46@tcp:34:lfs.0 00010000:00010000:3.0:1790710857.342476:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645000/0xcbad34b28157138c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.342493:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645000/0xcbad34b28157138c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.342504:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645000/0xcbad34b28157138c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.342517:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1644a00/0xcbad34b281571393 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.342540:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1644a00/0xcbad34b281571393 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.342547:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1644a00/0xcbad34b281571393 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.342781:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b28157139a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.342790:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b28157139a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.342797:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b28157139a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790710857.342831:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b28157139a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.342842:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645000/0xcbad34b28157138c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.342849:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645000/0xcbad34b28157138c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.342857:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645000/0xcbad34b28157138c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.342863:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c1645000 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1790710857.342867:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645000/0xcbad34b28157138c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.342874:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645000/0xcbad34b28157138c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.342892:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c51c2c2ee00) 00010000:00010000:3.0:1790710857.342895:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790710857.342899:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645000/0xcbad34b28157138c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.342906:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645000/0xcbad34b28157138c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.342918:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1644a00/0xcbad34b281571393 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.342924:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1644a00/0xcbad34b281571393 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.342929:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1644a00/0xcbad34b281571393 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.342934:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c1644a00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1790710857.342937:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1644a00/0xcbad34b281571393 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.342942:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1644a00/0xcbad34b281571393 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.342948:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c51c2c2e100) 00010000:00010000:3.0:1790710857.342950:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790710857.342952:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1644a00/0xcbad34b281571393 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.342958:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1644a00/0xcbad34b281571393 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.342980:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b28157139a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.342986:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b28157139a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.342991:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b28157139a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.342996:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c1645200 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1790710857.342999:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b28157139a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.343004:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b28157139a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.343010:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c51cca25000) 00010000:00010000:3.0:1790710857.343013:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790710857.343015:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b28157139a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.343021:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b28157139a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710857.343092:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c75dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+27:10464:x1877696158152576:12345-192.168.206.46@tcp:34:lfs.0 Request processed in 684us (852us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710857.343099:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 91 00000100:00100000:3.0:1790710857.407543:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710857.407852:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158152832 00000100:00100000:0.0:1790710857.407863:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158152832 00000100:00100000:0.0:1790710857.407925:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 92 00000100:00100000:0.0:1790710857.407935:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9764a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+27:10467:x1877696158152832:12345-192.168.206.46@tcp:101:lfs.0 00010000:00010000:0.0:1790710857.407964:0:8060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790710857.407983:0:8060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030c00/0xcbad34b2815713a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b05700053c expref: -99 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710857.408060:0:8060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b2815713a8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710857.408075:0:8060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b2815713a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710857.408086:0:8060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b2815713a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710857.408100:0:8060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031600/0xcbad34b2815713af lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710857.408107:0:8060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031600/0xcbad34b2815713af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710857.408113:0:8060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031600/0xcbad34b2815713af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710857.408402:0:8060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031800/0xcbad34b2815713b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710857.408412:0:8060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031800/0xcbad34b2815713b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710857.408420:0:8060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031800/0xcbad34b2815713b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790710857.408429:0:8060:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1790710857.408516:0:8060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b2815713a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710857.408524:0:8060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b2815713a8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710857.408531:0:8060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b2815713a8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710857.408536:0:8060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c0030000 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1790710857.408540:0:8060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b2815713a8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710857.408548:0:8060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b2815713a8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710857.408559:0:8060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c51c2c2ee00) 00010000:00010000:0.0:1790710857.408562:0:8060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790710857.408566:0:8060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b2815713a8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710857.408582:0:8060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b2815713a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710857.408594:0:8060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031600/0xcbad34b2815713af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710857.408599:0:8060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031600/0xcbad34b2815713af lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710857.408604:0:8060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031600/0xcbad34b2815713af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710857.408609:0:8060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c0031600 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1790710857.408611:0:8060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031600/0xcbad34b2815713af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710857.408617:0:8060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031600/0xcbad34b2815713af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710857.408624:0:8060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c51e4efb100) 00010000:00010000:0.0:1790710857.408626:0:8060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790710857.408825:0:8060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031600/0xcbad34b2815713af lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710857.408832:0:8060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031600/0xcbad34b2815713af lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710857.408876:0:8060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030c00/0xcbad34b2815713a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700053c expref: 30 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710857.408889:0:8060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031800/0xcbad34b2815713b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700053c expref: 29 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710857.408903:0:8060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c51cca25000) 00010000:00010000:0.0:1790710857.408906:0:8060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1790710857.408908:0:8060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c0031800, rc 0) 00000100:00100000:0.0:1790710857.408976:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9764a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+29:10467:x1877696158152832:12345-192.168.206.46@tcp:101:lfs.0 Request processed in 1042us (1441us total) trans 4294967370 rc 0/0 00000100:00100000:0.0:1790710857.408984:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 92 00000100:00100000:1.0:1790710857.411663:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710857.411762:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158152960 00000100:00100000:3.0:1790710857.411771:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158152960 00000100:00100000:3.0:1790710857.411840:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 93 00000100:00100000:3.0:1790710857.411850:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f457ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+29:10467:x1877696158152960:12345-192.168.206.46@tcp:54:lfs.0 00010000:00010000:3.0:1790710857.411914:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b2815713c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.411930:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b281571369 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000527 expref: 29 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.411939:0:5847:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b2815713c4 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.411975:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b281571369 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.46@tcp remote: 0x566877b057000527 expref: 29 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.411989:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b281571369 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000527 expref: 29 pid: 5845 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710857.412003:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9767100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1877696177047040:192.168.206.46@tcp:104: 00000100:00100000:3.0:1790710857.413347:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c2b58900 going to sleep for 11 seconds 00000040:00080000:0.0:1790710857.423954:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790710857.423964:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790710857.424018:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1790710857.424024:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790710857.426791:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9767100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1877696177047040:192.168.206.46@tcp:104: 00010000:00010000:3.0:1790710857.426822:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b2815713c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710857.426950:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710857.427341:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158153216 00000100:00100000:3.0:1790710857.427349:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158153216 00000100:00100000:3.0:1790710857.427415:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 22 00000100:00100000:3.0:1790710857.427425:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f457fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+30:5593:x1877696158153216:12345-192.168.206.46@tcp:35:ldlm_bl.0 00000001:00080000:3.0:1790710857.427671:0:5848:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967371 00000100:00100000:3.0:1790710857.427805:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f457fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+32:5593:x1877696158153216:12345-192.168.206.46@tcp:35:ldlm_bl.0 Request processed in 379us (853us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1790710857.427813:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 22 00000020:00080000:3.0:1790710857.427818:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1790710857.435731:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710857.435826:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158153344 00000100:00100000:0.0:1790710857.435836:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158153344 00010000:00010000:0.0:1790710857.435877:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b281571369 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000527 expref: 32 pid: 5845 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710857.435919:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 48 00000100:00100000:0.0:1790710857.435929:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f457d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+32:2358:x1877696158153344:12345-192.168.206.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790710857.435943:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790710857.435950:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b281571369 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000527 expref: 32 pid: 5845 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710857.435964:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b281571369 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000527 expref: 32 pid: 5845 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710857.435985:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b281571369 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000527 expref: 32 pid: 5845 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710857.436021:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c51cca25000) 00010000:00010000:0.0:1790710857.436026:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b2815713c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710857.436037:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b2815713c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710857.436045:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b2815713c4 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710857.436081:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790710857.436171:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f457d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+31:2358:x1877696158153344:12345-192.168.206.46@tcp:103:ldlm_bl.0 Request processed in 242us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710857.436178:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 48 00010000:00010000:2.0:1790710857.436759:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b2815713c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710857.436769:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b2815713c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710857.436797:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b2815713c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710857.436805:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b2815713c4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710857.436811:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b2815713c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710857.436816:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c1645200 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1790710857.436821:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b2815713c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710857.436827:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b2815713c4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710857.436837:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c51cca25000) 00010000:00010000:2.0:1790710857.436849:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790710857.436854:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b2815713c4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710857.436860:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b2815713c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710857.436921:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f457ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+30:10467:x1877696158152960:12345-192.168.206.46@tcp:54:lfs.0 Request processed in 25072us (25266us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710857.436930:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 93 00000100:00100000:1.0:1790710857.450451:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710857.450553:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158153600 00000100:00100000:3.0:1790710857.450563:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158153600 00000100:00100000:3.0:1790710857.450617:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 23 00000100:00100000:3.0:1790710857.450626:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f457ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+30:10467:x1877696158153600:12345-192.168.206.46@tcp:35:lfs.0 00000100:00100000:3.0:1790710857.450842:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f457ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+31:10467:x1877696158153600:12345-192.168.206.46@tcp:35:lfs.0 Request processed in 216us (399us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1790710857.450850:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 23 00000100:00100000:2.0:1790710857.582230:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710857.582314:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158153856 00000100:00100000:3.0:1790710857.582323:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158153856 00000100:00100000:3.0:1790710857.582375:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 94 00000100:00100000:3.0:1790710857.582385:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51fa2cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+31:10478:x1877696158153856:12345-192.168.206.46@tcp:101:cat.0 00010000:00010000:3.0:1790710857.582409:0:8060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790710857.582428:0:8060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1644a00/0xcbad34b2815713cb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b057000543 expref: -99 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.582492:0:8060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645000/0xcbad34b2815713d2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.582507:0:8060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645000/0xcbad34b2815713d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.582518:0:8060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645000/0xcbad34b2815713d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.582532:0:8060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645800/0xcbad34b2815713d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.582547:0:8060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645800/0xcbad34b2815713d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.582554:0:8060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645800/0xcbad34b2815713d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.582816:0:8060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645e00/0xcbad34b2815713e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.582827:0:8060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645e00/0xcbad34b2815713e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.582834:0:8060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645e00/0xcbad34b2815713e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790710857.582843:0:8060:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:3.0:1790710857.582925:0:8060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645000/0xcbad34b2815713d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.582932:0:8060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645000/0xcbad34b2815713d2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.582939:0:8060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645000/0xcbad34b2815713d2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.582944:0:8060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c1645000 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1790710857.582948:0:8060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645000/0xcbad34b2815713d2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.582955:0:8060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645000/0xcbad34b2815713d2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.582974:0:8060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c51c2c2ee00) 00010000:00010000:3.0:1790710857.582977:0:8060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790710857.582981:0:8060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645000/0xcbad34b2815713d2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.582986:0:8060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645000/0xcbad34b2815713d2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.582998:0:8060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645800/0xcbad34b2815713d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.583004:0:8060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645800/0xcbad34b2815713d9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.583009:0:8060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645800/0xcbad34b2815713d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.583013:0:8060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c1645800 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1790710857.583016:0:8060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645800/0xcbad34b2815713d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.583021:0:8060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645800/0xcbad34b2815713d9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.583027:0:8060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c51c2c2e100) 00010000:00010000:3.0:1790710857.583029:0:8060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790710857.583031:0:8060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645800/0xcbad34b2815713d9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.583036:0:8060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645800/0xcbad34b2815713d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.583100:0:8060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1644a00/0xcbad34b2815713cb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000543 expref: 34 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.583115:0:8060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645e00/0xcbad34b2815713e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000543 expref: 33 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.583121:0:8060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c51cca25000) 00010000:00010000:3.0:1790710857.583123:0:8060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790710857.583161:0:8060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c1645e00, rc 0) 00000100:00100000:3.0:1790710857.583227:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51fa2cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+33:10478:x1877696158153856:12345-192.168.206.46@tcp:101:cat.0 Request processed in 843us (1005us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1790710857.583235:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 94 00000100:00100000:1.0:1790710857.589807:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710857.590080:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158154112 00000100:00100000:3.0:1790710857.590090:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158154112 00000100:00100000:3.0:1790710857.590155:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 24 00000100:00100000:3.0:1790710857.590164:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f457f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+33:10478:x1877696158154112:12345-192.168.206.46@tcp:35:cat.0 00000100:00100000:3.0:1790710857.590380:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f457f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+34:10478:x1877696158154112:12345-192.168.206.46@tcp:35:cat.0 Request processed in 216us (580us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1790710857.590388:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 24 00000001:00080000:3.0:1790710857.603744:0:6720:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00080000:3.0:1790710857.603760:0:6720:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:3.0:1790710857.614730:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710857.617383:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158154368 00000100:00100000:0.0:1790710857.617398:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158154368 00000100:00100000:1.0:1790710857.620088:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 95 00000100:00100000:1.0:1790710857.620102:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9767100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+34:10479:x1877696158154368:12345-192.168.206.46@tcp:36:rm.0 00010000:00010000:1.0:1790710857.620529:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1790710857.620560:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645e00/0xcbad34b2815713e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000543 expref: 34 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710857.620584:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031800/0xcbad34b2815713b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700053c expref: 33 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710857.620599:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031a00/0xcbad34b28157137e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700052e expref: 32 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710857.620608:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c51cca25000) 00010000:00010000:1.0:1790710857.620617:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790710857.620636:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b2815713ee lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710857.620648:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b2815713ee lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710857.620657:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b2815713ee lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710857.620669:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b2815713f5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710857.620676:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b2815713f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710857.620698:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b2815713f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710857.620923:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481400/0xcbad34b2815713fc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710857.620931:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481400/0xcbad34b2815713fc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710857.620937:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481400/0xcbad34b2815713fc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790710857.626589:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:1.0:1790710857.626603:0:5846:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 334963474315ns, next at 335963471417ns, rc = 0 00010000:00010000:1.0:1790710857.626675:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480200/0xcbad34b281571403 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710857.626692:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480200/0xcbad34b281571403 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710857.626704:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480200/0xcbad34b281571403 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710857.626712:0:5846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480200/0xcbad34b281571403 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710857.626733:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480200/0xcbad34b281571403 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710857.626739:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480200/0xcbad34b281571403 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710857.626776:0:5846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790710857.626798:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481400/0xcbad34b2815713fc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710857.626805:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481400/0xcbad34b2815713fc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710857.626812:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481400/0xcbad34b2815713fc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710857.626817:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c6481400 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1790710857.626821:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481400/0xcbad34b2815713fc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710857.626829:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481400/0xcbad34b2815713fc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710857.626841:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c51d8e33500) 00010000:00010000:1.0:1790710857.626844:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1790710857.626848:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481400/0xcbad34b2815713fc lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710857.626855:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481400/0xcbad34b2815713fc lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710857.626874:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b2815713ee lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710857.626881:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b2815713ee lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710857.626887:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b2815713ee lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710857.626898:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c6481c00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1790710857.626900:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b2815713ee lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710857.626906:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b2815713ee lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710857.626915:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c51c2c2ee00) 00010000:00010000:1.0:1790710857.626918:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790710857.626921:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b2815713ee lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710857.626926:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b2815713ee lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790710857.626937:0:5846:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000f97d6bd2 reply state 00000000fdc12e5a transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b2815713f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710857.626947:0:5846:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790710857.627037:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9767100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+33:10479:x1877696158154368:12345-192.168.206.46@tcp:36:rm.0 Request processed in 6934us (12325us total) trans 4294967376 rc 0/0 00000100:00100000:1.0:1790710857.627045:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 95 00010000:00010000:3.0:1790710857.627293:0:8509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790710857.627301:0:8509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480200/0xcbad34b281571403 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.627318:0:8509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c6480200 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:3.0:1790710857.627321:0:8509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480200/0xcbad34b281571403 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.627328:0:8509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480200/0xcbad34b281571403 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.627337:0:8509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c51d8e33500) 00010000:00010000:3.0:1790710857.627340:0:8509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1790710857.627344:0:8509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480200/0xcbad34b281571403 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.627349:0:8509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480200/0xcbad34b281571403 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.627365:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790710857.627367:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790710857.627368:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710857.629704:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b2815713f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710857.629799:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b2815713f5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710857.629807:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b2815713f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710857.629813:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c6480e00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1790710857.629885:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b2815713f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710857.629895:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b2815713f5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710857.629912:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c51d8e33c00) 00010000:00010000:2.0:1790710857.629915:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790710857.629920:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b2815713f5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710857.629947:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b2815713f5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710857.689522:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710857.689790:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158154624 00000100:00100000:0.0:1790710857.689800:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158154624 00000100:00100000:0.0:1790710857.689858:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 96 00000100:00100000:0.0:1790710857.689868:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9765180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+32:10485:x1877696158154624:12345-192.168.206.46@tcp:101:bash.0 00010000:00010000:0.0:1790710857.689894:0:8060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790710857.689915:0:8060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b400/0xcbad34b28157140a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b05700054a expref: -99 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710857.690026:0:8060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243be00/0xcbad34b281571411 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710857.690042:0:8060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243be00/0xcbad34b281571411 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710857.690081:0:8060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243be00/0xcbad34b281571411 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710857.690096:0:8060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243bc00/0xcbad34b281571418 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710857.690103:0:8060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243bc00/0xcbad34b281571418 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710857.690109:0:8060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243bc00/0xcbad34b281571418 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790710857.690667:0:8060:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:0.0:1790710857.690834:0:8060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ba00/0xcbad34b28157141f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710857.690845:0:8060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ba00/0xcbad34b28157141f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710857.690858:0:8060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ba00/0xcbad34b28157141f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710857.690894:0:8060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243be00/0xcbad34b281571411 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710857.690902:0:8060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243be00/0xcbad34b281571411 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710857.690909:0:8060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243be00/0xcbad34b281571411 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710857.690916:0:8060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c243be00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1790710857.690927:0:8060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243be00/0xcbad34b281571411 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710857.690935:0:8060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243be00/0xcbad34b281571411 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710857.690947:0:8060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c51c2c2ee00) 00010000:00010000:0.0:1790710857.690951:0:8060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790710857.690956:0:8060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243be00/0xcbad34b281571411 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710857.690963:0:8060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243be00/0xcbad34b281571411 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790710857.690975:0:8060:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000002a83664e reply state 000000007ae8e90f transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243bc00/0xcbad34b281571418 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710857.690983:0:8060:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1790710857.691013:0:8060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b400/0xcbad34b28157140a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700054a expref: 35 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710857.691026:0:8060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ba00/0xcbad34b28157141f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700054a expref: 34 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710857.691033:0:8060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c51e4efb100) 00010000:00010000:0.0:1790710857.691036:0:8060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790710857.691038:0:8060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c243ba00, rc 0) 00000100:00100000:0.0:1790710857.691100:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9765180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+35:10485:x1877696158154624:12345-192.168.206.46@tcp:101:bash.0 Request processed in 1233us (1590us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1790710857.691108:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 96 00010000:00010000:2.0:1790710857.694303:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243bc00/0xcbad34b281571418 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710857.694320:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243bc00/0xcbad34b281571418 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710857.694328:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243bc00/0xcbad34b281571418 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710857.694334:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c243bc00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1790710857.694339:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243bc00/0xcbad34b281571418 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710857.694347:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243bc00/0xcbad34b281571418 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710857.694363:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c51e4efbf00) 00010000:00010000:2.0:1790710857.694366:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790710857.694371:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243bc00/0xcbad34b281571418 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710857.694376:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243bc00/0xcbad34b281571418 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710857.698258:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710857.698344:0:6696:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158154752 00000100:00100000:0.0:1790710857.698353:0:6696:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158154752 00000100:00100000:0.0:1790710857.698405:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 34 00000100:00100000:0.0:1790710857.698415:0:6696:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9765880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+5:2358:x1877696158154752:12345-192.168.206.46@tcp:101:bash.0 00010000:00010000:0.0:1790710857.698433:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790710857.698451:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e092b749/0xcbad34b28157142d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b057000551 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790710857.698477:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790710857.698496:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=335s v=(0 0) 00010000:00010000:0.0:1790710857.698501:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790710857.698510:0:6696:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e092b749/0xcbad34b28157142d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000551 expref: 6 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710857.698529:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e092b749/0xcbad34b28157142d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000551 expref: 6 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710857.698541:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c243b400, rc 0) 00000100:00100000:0.0:1790710857.698599:0:6696:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9765880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:2358:x1877696158154752:12345-192.168.206.46@tcp:101:bash.0 Request processed in 186us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710857.698606:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 34 00000100:00100000:3.0:1790710857.703390:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710857.703484:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158154880 00000100:00100000:2.0:1790710857.703493:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158154880 00000100:00100000:2.0:1790710857.703541:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 35 00000100:00100000:2.0:1790710857.703551:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9a51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:10485:x1877696158154880:12345-192.168.206.46@tcp:101:bash.0 00010000:00010000:2.0:1790710857.703582:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790710857.703600:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d35a299c/0xcbad34b281571434 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b057000558 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710857.703630:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e092b749/0xcbad34b28157142d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000551 expref: 7 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710857.703640:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790710857.703644:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790710857.703649:0:6697:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d35a299c/0xcbad34b281571434 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000558 expref: 7 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710857.703681:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e092b749/0xcbad34b28157142d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.46@tcp remote: 0x566877b057000551 expref: 7 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710857.703695:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e092b749/0xcbad34b28157142d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000551 expref: 7 pid: 6696 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710857.703709:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51fa2cd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6697:1877696177047168:192.168.206.46@tcp:104: 00000100:00100000:2.0:1790710857.703795:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f956d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790710857.711945:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710857.712026:0:8449:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158155008 00000100:00100000:3.0:1790710857.712036:0:8449:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158155008 00010000:00010000:3.0:1790710857.712087:0:8449:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e092b749/0xcbad34b28157142d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000551 expref: 8 pid: 6696 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710857.712165:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 49 00000100:00100000:3.0:1790710857.712174:0:8449:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8e5e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+8:2359:x1877696158155008:12345-192.168.206.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790710857.712218:0:8449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790710857.712239:0:8449:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e092b749/0xcbad34b28157142d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000551 expref: 8 pid: 6696 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.712253:0:8449:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e092b749/0xcbad34b28157142d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000551 expref: 8 pid: 6696 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.712292:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790710857.712297:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790710857.712308:0:8449:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d35a299c/0xcbad34b281571434 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000558 expref: 8 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.712318:0:8449:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d35a299c/0xcbad34b281571434 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000558 expref: 8 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.712358:0:8449:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000d35a299c/0xcbad34b281571434 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000558 expref: 8 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710857.712371:0:8449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9764380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8449:1877696177047296:192.168.206.46@tcp:105: 00000100:00100000:3.0:1790710857.712443:0:8449:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c8dc7300 going to sleep for 11 seconds 00010000:00010000:2.0:1790710857.712781:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e092b749/0xcbad34b28157142d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000551 expref: 8 pid: 6696 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710857.712797:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51fa2cd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6697:1877696177047168:192.168.206.46@tcp:104: 00010000:00010000:2.0:1790710857.712821:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d35a299c/0xcbad34b281571434 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.46@tcp remote: 0x566877b057000558 expref: 7 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710857.712840:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c8047800, rc 0) 00000100:00100000:2.0:1790710857.712883:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9a51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+7:10485:x1877696158154880:12345-192.168.206.46@tcp:101:bash.0 Request processed in 9333us (9500us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710857.712890:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 35 00000100:00100000:1.0:1790710857.720637:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710857.720739:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158155264 00000100:00100000:0.0:1790710857.720749:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158155264 00000100:00100000:0.0:1790710857.720810:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 25 00000100:00100000:0.0:1790710857.720821:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f457d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+34:10485:x1877696158155264:12345-192.168.206.46@tcp:35:bash.0 00000100:00100000:0.0:1790710857.721192:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f457d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+35:10485:x1877696158155264:12345-192.168.206.46@tcp:35:bash.0 Request processed in 372us (563us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1790710857.721224:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 25 00000100:00100000:3.0:1790710857.721826:0:8449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9764380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8449:1877696177047296:192.168.206.46@tcp:105: 00010000:00010000:3.0:1790710857.721849:0:8449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790710857.721893:0:8449:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8e5e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:2359:x1877696158155008:12345-192.168.206.46@tcp:103:ldlm_bl.0 Request processed in 9720us (9957us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710857.721903:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 49 00000100:00100000:1.0:1790710857.952500:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710857.953685:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158155392 00000100:00100000:2.0:1790710857.953697:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158155392 00000100:00100000:2.0:1790710857.953807:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 97 00000100:00100000:2.0:1790710857.953818:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f457d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+35:10501:x1877696158155392:12345-192.168.206.46@tcp:101:lfs.0 00010000:00010000:2.0:1790710857.953846:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790710857.953868:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b28157143b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b05700055f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710857.953963:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b281571442 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710857.953978:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b281571442 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710857.953989:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b281571442 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790710857.954021:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1790710857.954025:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790710857.954057:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b281571442 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710857.954080:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b28157143b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700055f expref: 37 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710857.954119:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b281571442 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700055f expref: 36 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710857.954161:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c51c2c2ee00) 00010000:00010000:2.0:1790710857.954165:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790710857.954168:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c8046800, rc 0) 00000100:00100000:2.0:1790710857.954241:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f457d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+36:10501:x1877696158155392:12345-192.168.206.46@tcp:101:lfs.0 Request processed in 425us (1749us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710857.954248:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 97 00000100:00100000:2.0:1790710857.958854:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710857.958932:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158155648 00000100:00100000:0.0:1790710857.958942:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158155648 00000100:00100000:0.0:1790710857.958994:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 98 00000100:00100000:0.0:1790710857.959004:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51fa2cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+36:10501:x1877696158155648:12345-192.168.206.46@tcp:101:lfs.0 00010000:00010000:0.0:1790710857.959025:0:8060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790710857.959065:0:8060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243be00/0xcbad34b281571449 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b057000566 expref: -99 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710857.959192:0:8060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b281571450 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710857.959217:0:8060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b281571450 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710857.959229:0:8060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b281571450 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790710857.959241:0:8060:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1790710857.959369:0:8060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243be00/0xcbad34b281571449 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000566 expref: 39 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710857.959387:0:8060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b281571450 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000566 expref: 38 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710857.959396:0:8060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c51e4efb100) 00010000:00010000:0.0:1790710857.959399:0:8060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790710857.959402:0:8060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c243b800, rc 0) 00000100:00100000:0.0:1790710857.959462:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51fa2cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+38:10501:x1877696158155648:12345-192.168.206.46@tcp:101:lfs.0 Request processed in 458us (616us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1790710857.959469:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 98 00000100:00100000:3.0:1790710857.965914:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710857.966057:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158156032 00000100:00100000:0.0:1790710857.966066:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158156032 00000100:00100000:0.0:1790710857.966124:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 6 00000100:00100000:0.0:1790710857.966160:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9764380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+38:2356:x1877696158156032:12345-192.168.206.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790710857.966177:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790710857.966214:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b281571450 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000566 expref: 38 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710857.966232:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c51e4efb100) 00010000:00010000:0.0:1790710857.966237:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790710857.966290:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9764380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+37:2356:x1877696158156032:12345-192.168.206.46@tcp:103:ldlm_bl.0 Request processed in 133us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710857.966297:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 6 00000100:00100000:1.0:1790710857.966997:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710857.967167:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158155904 00000100:00100000:3.0:1790710857.967174:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158155904 00000100:00100000:3.0:1790710857.967224:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 99 00000100:00100000:3.0:1790710857.967232:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f457c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+37:10501:x1877696158155904:12345-192.168.206.46@tcp:101:lfs.0 00010000:00010000:3.0:1790710857.967255:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790710857.967271:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b28157145e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b05700056d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.967354:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1644a00/0xcbad34b281571465 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.967369:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1644a00/0xcbad34b281571465 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.967380:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1644a00/0xcbad34b281571465 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790710857.967392:0:5846:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1790710857.967505:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b28157145e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700056d expref: 40 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.967685:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1644a00/0xcbad34b281571465 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700056d expref: 39 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710857.967694:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c51e4efb100) 00010000:00010000:3.0:1790710857.967697:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1790710857.967700:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c1644a00, rc 0) 00000100:00100000:3.0:1790710857.967795:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f457c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+39:10501:x1877696158155904:12345-192.168.206.46@tcp:101:lfs.0 Request processed in 563us (799us total) trans 4294967380 rc 0/0 00000100:00100000:3.0:1790710857.968382:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 99 00000100:00100000:2.0:1790710857.975907:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710857.976061:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158156160 00000100:00100000:0.0:1790710857.976070:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158156160 00000100:00100000:0.0:1790710857.976142:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 36 00000100:00100000:0.0:1790710857.976153:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51fa2cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:2359:x1877696158156160:12345-192.168.206.46@tcp:1:lfs.0 00010000:00010000:0.0:1790710857.976204:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034fbb71d/0xcbad34b281571473 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710857.976225:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d35a299c/0xcbad34b281571434 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.46@tcp remote: 0x566877b057000558 expref: 6 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710857.976234:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790710857.976251:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790710857.976257:0:6698:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034fbb71d/0xcbad34b281571473 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710857.976291:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d35a299c/0xcbad34b281571434 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.46@tcp remote: 0x566877b057000558 expref: 6 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710857.976306:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d35a299c/0xcbad34b281571434 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.46@tcp remote: 0x566877b057000558 expref: 6 pid: 6697 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710857.976321:0:6698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51d03ed880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6698:1877696177047424:192.168.206.46@tcp:104: 00000100:00100000:0.0:1790710857.976841:0:6698:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51d8a96e40 going to sleep for 11 seconds 00000100:00100000:2.0:1790710857.985764:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710857.985799:0:6698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51d03ed880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6698:1877696177047424:192.168.206.46@tcp:104: 00010000:00010000:0.0:1790710857.985828:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000034fbb71d/0xcbad34b281571473 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710857.985910:0:6702:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158156288 00000100:00100000:1.0:1790710857.985918:0:6702:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158156288 00002000:00100000:1.0:1790710857.985973:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9c51fa2ced80 x1877696158156288/t0(0) o4->0ec73bd1-726e-4dc0-8edd-807d3f973d65@192.168.206.46@tcp:358/0 lens 504/0 e 0 to 0 dl 1790710868 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790710857.985998:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c51fa2ced80 with x1877696158156288 ext(0->8) 00010000:00010000:1.0:1790710857.986007:0:6702:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000d35a299c/0xcbad34b281571434 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.46@tcp remote: 0x566877b057000558 expref: 7 pid: 6697 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710857.986021:0:6702:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000d35a299c/0xcbad34b281571434 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.46@tcp remote: 0x566877b057000558 expref: 7 pid: 6697 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790710857.986030:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9c51fa2ced80 00000100:00100000:1.0:1790710857.986067:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 1 00000100:00100000:1.0:1790710857.986077:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51fa2ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+7:2359:x1877696158156288:12345-192.168.206.46@tcp:4:lfs.0 00000100:00100000:1.0:1790710857.986597:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51fa2ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+9:2359:x1877696158156288:12345-192.168.206.46@tcp:4:lfs.0 Request processed in 519us (839us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1790710857.986606:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 1 00002000:00100000:1.0:1790710857.986614:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9c51fa2ced80 x1877696158156288/t4294967302(0) o4->0ec73bd1-726e-4dc0-8edd-807d3f973d65@192.168.206.46@tcp:358/0 lens 504/448 e 0 to 0 dl 1790710868 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790710857.986622:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c51fa2ced80 with x1877696158156288 ext(0->8) 00010000:00010000:1.0:1790710857.986628:0:6702:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000d35a299c/0xcbad34b281571434 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.46@tcp remote: 0x566877b057000558 expref: 9 pid: 6697 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710857.986640:0:6702:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000d35a299c/0xcbad34b281571434 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.46@tcp remote: 0x566877b057000558 expref: 9 pid: 6697 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790710857.986646:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9c51fa2ced80 00000100:00100000:1.0:1790710857.993000:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710857.993746:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158156416 00000100:00100000:0.0:1790710857.993756:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158156416 00010000:00010000:0.0:1790710857.993805:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d35a299c/0xcbad34b281571434 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.46@tcp remote: 0x566877b057000558 expref: 9 pid: 6697 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710857.993847:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 50 00000100:00100000:0.0:1790710857.993856:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f457ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+9:2356:x1877696158156416:12345-192.168.206.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790710857.993871:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1790710857.993888:0:5830:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1790710857.993891:0:5830:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1790710857 00002000:00010000:0.0:1790710857.993900:0:5830:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1790710857 00002000:00010000:0.0:1790710857.993902:0:5830:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1790710857 00010000:00010000:0.0:1790710857.993909:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d35a299c/0xcbad34b281571434 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.46@tcp remote: 0x566877b057000558 expref: 9 pid: 6697 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710857.993923:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d35a299c/0xcbad34b281571434 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.46@tcp remote: 0x566877b057000558 expref: 9 pid: 6697 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710857.993955:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d35a299c/0xcbad34b281571434 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.46@tcp remote: 0x566877b057000558 expref: 9 pid: 6697 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710857.993970:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790710857.993975:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790710857.993980:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000034fbb71d/0xcbad34b281571473 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710857.993989:0:5830:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034fbb71d/0xcbad34b281571473 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710857.994023:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790710857.994336:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f457ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+8:2356:x1877696158156416:12345-192.168.206.46@tcp:103:ldlm_bl.0 Request processed in 480us (1344us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710857.994344:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 50 00010000:00010000:1.0:1790710857.995704:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000034fbb71d/0xcbad34b281571473 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710857.995721:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000034fbb71d/0xcbad34b281571473 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710857.995753:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034fbb71d/0xcbad34b281571473 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710857.995762:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000034fbb71d/0xcbad34b281571473 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710857.995771:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000034fbb71d/0xcbad34b281571473 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710857.995778:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c243b800 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:1.0:1790710857.995783:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000034fbb71d/0xcbad34b281571473 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710857.995791:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000034fbb71d/0xcbad34b281571473 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710857.995829:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000034fbb71d/0xcbad34b281571473 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710857.995836:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034fbb71d/0xcbad34b281571473 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710857.995927:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51fa2cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+7:2359:x1877696158156160:12345-192.168.206.46@tcp:1:lfs.0 Request processed in 19775us (20027us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710857.995936:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 36 00000100:00100000:1.0:1790710858.003953:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710858.004087:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158156672 00000100:00100000:0.0:1790710858.004097:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158156672 00000100:00100000:0.0:1790710858.004451:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 26 00000100:00100000:0.0:1790710858.004462:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d6261050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+39:10501:x1877696158156672:12345-192.168.206.46@tcp:35:lfs.0 00000004:00010000:0.0:1790710858.004544:0:5848:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1644a00/0xcbad34b281571465 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700056d expref: 39 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790710858.004851:0:5848:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:0.0:1790710858.004902:0:5848:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:0.0:1790710858.005414:0:5848:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967383 00010000:00010000:0.0:1790710858.005468:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243be00/0xcbad34b28157147a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710858.005485:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ba00/0xcbad34b28157141f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700054a expref: 43 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710858.005495:0:5848:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243be00/0xcbad34b28157147a lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710858.005528:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ba00/0xcbad34b28157141f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.46@tcp remote: 0x566877b05700054a expref: 43 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710858.005543:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ba00/0xcbad34b28157141f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.46@tcp remote: 0x566877b05700054a expref: 43 pid: 8060 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710858.005557:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51d03ed880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5848:1877696177047552:192.168.206.46@tcp:104: 00000100:00100000:0.0:1790710858.005645:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51d8a96180 going to sleep for 11 seconds 00000100:00100000:3.0:1790710858.011240:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710858.012252:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158156800 00000100:00100000:2.0:1790710858.012333:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158156800 00010000:00010000:2.0:1790710858.012380:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ba00/0xcbad34b28157141f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.46@tcp remote: 0x566877b05700054a expref: 44 pid: 8060 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710858.012429:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 51 00000100:00100000:2.0:1790710858.012439:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9766d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+44:2358:x1877696158156800:12345-192.168.206.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790710858.012454:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790710858.012461:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ba00/0xcbad34b28157141f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.46@tcp remote: 0x566877b05700054a expref: 44 pid: 8060 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710858.012473:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ba00/0xcbad34b28157141f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.46@tcp remote: 0x566877b05700054a expref: 44 pid: 8060 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710858.012513:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c51e4efb100) 00010000:00010000:2.0:1790710858.012517:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243be00/0xcbad34b28157147a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710858.012526:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243be00/0xcbad34b28157147a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710858.012534:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243be00/0xcbad34b28157147a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710858.012551:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790710858.012602:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9766d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+44:2358:x1877696158156800:12345-192.168.206.46@tcp:103:ldlm_bl.0 Request processed in 164us (1371us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710858.012610:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 51 00010000:00010000:0.0:1790710858.012727:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ba00/0xcbad34b28157141f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.46@tcp remote: 0x566877b05700054a expref: 43 pid: 8060 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710858.012744:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51d03ed880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5848:1877696177047552:192.168.206.46@tcp:104: 00010000:00010000:0.0:1790710858.012766:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243be00/0xcbad34b28157147a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710858.012781:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243be00/0xcbad34b28157147a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710858.012788:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243be00/0xcbad34b28157147a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790710858.012924:0:5848:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967384 00000001:00080000:0.0:1790710858.014417:0:5848:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:0.0:1790710858.014539:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51d03ed880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5848:1877696177047680:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1790710858.014598:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710858.014633:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c2b58900 going to sleep for 11 seconds 00000100:00100000:1.0:1790710858.015331:0:5851:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177047680 00000100:00100000:1.0:1790710858.015339:0:5851:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177047680 00000100:00100000:1.0:1790710858.015446:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790710858.015456:0:5851:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d03ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5848:x1877696177047680:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1790710858.015552:0:5851:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d03ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5848:x1877696177047680:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 97us (952us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710858.015560:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1790710858.016023:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790710858.017576:0:5848:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:2.0:1790710858.017585:0:5848:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:2.0:1790710858.017605:0:5848:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c51f9575500, transno 4294967301 00000100:00100000:2.0:1790710858.017629:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51d03ed880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5848:1877696177047680:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1790710858.019524:0:5848:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:2.0:1790710858.019613:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51fa2cf480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5848:1877696177047808:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1790710858.019678:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710858.019772:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f956dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1790710858.022917:0:5851:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177047808 00000100:00100000:1.0:1790710858.022932:0:5851:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177047808 00000100:00100000:1.0:1790710858.023240:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790710858.023253:0:5851:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51fa2ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5848:x1877696177047808:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1790710858.023532:0:5851:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51fa2ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5848:x1877696177047808:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 282us (3853us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1790710858.023541:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790710858.023633:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51fa2cf480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5848:1877696177047808:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1790710858.023703:0:5848:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:2.0:1790710858.023748:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243be00/0xcbad34b28157147a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710858.023774:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243be00/0xcbad34b28157147a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710858.023782:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243be00/0xcbad34b28157147a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710858.023787:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c243be00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1790710858.023792:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243be00/0xcbad34b28157147a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710858.023799:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243be00/0xcbad34b28157147a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710858.023813:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c51e4efb100) 00010000:00010000:2.0:1790710858.023817:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1790710858.023821:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243be00/0xcbad34b28157147a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710858.023828:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243be00/0xcbad34b28157147a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790710858.024033:0:5848:0:(mdd_object.c:4180:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1790710858.024164:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:2.0:1790710858.024176:0:5848:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 335361047586ns, next at 336361045396ns, rc = 0 00000001:00080000:2.0:1790710858.024182:0:5848:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:2.0:1790710858.024224:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c51e4efb100) 00010000:00010000:2.0:1790710858.024227:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1790710858.024235:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1644a00/0xcbad34b281571465 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700056d expref: 47 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710858.024345:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d6261050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+46:10501:x1877696158156672:12345-192.168.206.46@tcp:35:lfs.0 Request processed in 19884us (20407us total) trans 4294967389 rc 0/0 00000100:00100000:2.0:1790710858.024354:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 26 00000020:00080000:2.0:1790710858.024358:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1790710858.028761:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710858.028818:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158156928 00000100:00100000:0.0:1790710858.028828:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158156928 00000100:00100000:0.0:1790710858.028889:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 100 00000100:00100000:0.0:1790710858.028898:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+46:10501:x1877696158156928:12345-192.168.206.46@tcp:101:lfs.0 00010000:00010000:0.0:1790710858.028923:0:8060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790710858.028946:0:8060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243a400/0xcbad34b281571481 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b057000574 expref: -99 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710858.029014:0:8060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243a400/0xcbad34b281571481 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000574 expref: 47 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710858.029028:0:8060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243a400/0xcbad34b281571481 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000574 expref: 47 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710858.029046:0:8060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c51e4efb800) 00010000:00010000:0.0:1790710858.029061:0:8060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790710858.029064:0:8060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c243a400, rc 0) 00000100:00100000:0.0:1790710858.029155:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+47:10501:x1877696158156928:12345-192.168.206.46@tcp:101:lfs.0 Request processed in 227us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710858.029163:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 100 00000100:00100000:0.0:1790710858.033281:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710858.034069:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158157184 00000100:00100000:1.0:1790710858.034080:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158157184 00000100:00100000:1.0:1790710858.034166:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 27 00000100:00100000:1.0:1790710858.034175:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d03eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+47:10501:x1877696158157184:12345-192.168.206.46@tcp:35:lfs.0 00000100:00100000:1.0:1790710858.034410:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d03eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+48:10501:x1877696158157184:12345-192.168.206.46@tcp:35:lfs.0 Request processed in 235us (1136us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1790710858.034434:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 27 00000100:00100000:1.0:1790710858.138995:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710858.139239:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158157312 00000100:00100000:2.0:1790710858.139249:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158157312 00000100:00100000:3.0:1790710858.139445:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 101 00000100:00100000:3.0:1790710858.139458:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f457f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+48:10511:x1877696158157312:12345-192.168.206.46@tcp:34:lfs.0 00010000:00010000:3.0:1790710858.139535:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281571488 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710858.139554:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281571488 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710858.139564:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281571488 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710858.139578:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645800/0xcbad34b28157148f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710858.139586:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645800/0xcbad34b28157148f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710858.139592:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645800/0xcbad34b28157148f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710858.139675:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645000/0xcbad34b281571496 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710858.139683:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645000/0xcbad34b281571496 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710858.139690:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645000/0xcbad34b281571496 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790710858.139744:0:5846:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645000/0xcbad34b281571496 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710858.139755:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281571488 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710858.139761:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281571488 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710858.139768:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281571488 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710858.139773:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c1645200 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1790710858.139777:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281571488 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710858.139784:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281571488 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710858.139795:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c51c2c2ee00) 00010000:00010000:3.0:1790710858.139798:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790710858.139802:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281571488 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710858.139808:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281571488 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710858.139820:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645800/0xcbad34b28157148f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710858.139826:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645800/0xcbad34b28157148f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710858.139838:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645800/0xcbad34b28157148f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710858.139842:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c1645800 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1790710858.139845:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645800/0xcbad34b28157148f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710858.139851:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645800/0xcbad34b28157148f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710858.139859:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c51c2c2e200) 00010000:00010000:3.0:1790710858.139860:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790710858.139863:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645800/0xcbad34b28157148f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710858.139868:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645800/0xcbad34b28157148f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710858.139882:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645000/0xcbad34b281571496 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710858.139888:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645000/0xcbad34b281571496 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710858.139893:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645000/0xcbad34b281571496 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710858.139898:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c1645000 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1790710858.139900:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645000/0xcbad34b281571496 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710858.139915:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645000/0xcbad34b281571496 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710858.139923:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c51e4efb800) 00010000:00010000:3.0:1790710858.139925:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790710858.139928:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645000/0xcbad34b281571496 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710858.139933:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645000/0xcbad34b281571496 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710858.140276:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f457f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+48:10511:x1877696158157312:12345-192.168.206.46@tcp:34:lfs.0 Request processed in 819us (1288us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710858.140285:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 101 00000100:00100000:3.0:1790710858.228488:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710858.228774:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158157568 00000100:00100000:0.0:1790710858.228784:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158157568 00000100:00100000:0.0:1790710858.228895:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 102 00000100:00100000:0.0:1790710858.228907:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9766680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+48:10514:x1877696158157568:12345-192.168.206.46@tcp:101:lfs.0 00010000:00010000:0.0:1790710858.228928:0:8060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790710858.228948:0:8060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b200/0xcbad34b28157149d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b05700057b expref: -99 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710858.229019:0:8060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243aa00/0xcbad34b2815714a4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710858.229034:0:8060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243aa00/0xcbad34b2815714a4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710858.229058:0:8060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243aa00/0xcbad34b2815714a4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710858.229083:0:8060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ac00/0xcbad34b2815714ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710858.229091:0:8060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ac00/0xcbad34b2815714ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710858.229096:0:8060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ac00/0xcbad34b2815714ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710858.231403:0:8060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b000/0xcbad34b2815714b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710858.231421:0:8060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b000/0xcbad34b2815714b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710858.231432:0:8060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b000/0xcbad34b2815714b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790710858.231443:0:8060:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1790710858.231543:0:8060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243aa00/0xcbad34b2815714a4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710858.231552:0:8060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243aa00/0xcbad34b2815714a4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710858.231559:0:8060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243aa00/0xcbad34b2815714a4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710858.231565:0:8060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c243aa00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1790710858.231570:0:8060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243aa00/0xcbad34b2815714a4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710858.231578:0:8060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243aa00/0xcbad34b2815714a4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710858.231591:0:8060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c51c2c2ee00) 00010000:00010000:0.0:1790710858.231594:0:8060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790710858.231599:0:8060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243aa00/0xcbad34b2815714a4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710858.231622:0:8060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243aa00/0xcbad34b2815714a4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710858.231637:0:8060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ac00/0xcbad34b2815714ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710858.231644:0:8060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ac00/0xcbad34b2815714ab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710858.231650:0:8060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ac00/0xcbad34b2815714ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710858.231656:0:8060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c243ac00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1790710858.231660:0:8060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ac00/0xcbad34b2815714ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710858.231666:0:8060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ac00/0xcbad34b2815714ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710858.231674:0:8060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c51e4efbc00) 00010000:00010000:0.0:1790710858.231676:0:8060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790710858.231679:0:8060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ac00/0xcbad34b2815714ab lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710858.231685:0:8060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ac00/0xcbad34b2815714ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710858.231732:0:8060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b200/0xcbad34b28157149d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700057b expref: 51 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710858.231745:0:8060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b000/0xcbad34b2815714b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700057b expref: 50 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710858.231759:0:8060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c51e4efb800) 00010000:00010000:0.0:1790710858.231761:0:8060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790710858.231763:0:8060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c243b000, rc 0) 00000100:00100000:0.0:1790710858.231841:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9766680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+50:10514:x1877696158157568:12345-192.168.206.46@tcp:101:lfs.0 Request processed in 2936us (3361us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1790710858.231850:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 102 00000100:00100000:0.0:1790710858.236601:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710858.236682:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158157696 00000100:00100000:2.0:1790710858.236693:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158157696 00000100:00100000:2.0:1790710858.236751:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 103 00000100:00100000:2.0:1790710858.236761:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d03ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+50:10514:x1877696158157696:12345-192.168.206.46@tcp:54:lfs.0 00010000:00010000:2.0:1790710858.236829:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046200/0xcbad34b2815714c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710858.236846:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046200/0xcbad34b2815714c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710858.236857:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046200/0xcbad34b2815714c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710858.236880:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046200/0xcbad34b2815714c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710858.236886:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046200/0xcbad34b2815714c0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710858.236893:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046200/0xcbad34b2815714c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710858.236898:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c8046200 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1790710858.236914:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046200/0xcbad34b2815714c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710858.236922:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046200/0xcbad34b2815714c0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710858.236933:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c51e4efb800) 00010000:00010000:2.0:1790710858.236937:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790710858.236941:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046200/0xcbad34b2815714c0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710858.236947:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046200/0xcbad34b2815714c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710858.237022:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d03ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+50:10514:x1877696158157696:12345-192.168.206.46@tcp:54:lfs.0 Request processed in 262us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710858.237030:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 103 00000100:00100000:1.0:1790710858.243627:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710858.243710:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158157952 00000100:00100000:0.0:1790710858.243721:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158157952 00000100:00100000:0.0:1790710858.243775:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 28 00000100:00100000:0.0:1790710858.243785:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f457e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+50:10514:x1877696158157952:12345-192.168.206.46@tcp:35:lfs.0 00000100:00100000:0.0:1790710858.244018:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f457e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+51:10514:x1877696158157952:12345-192.168.206.46@tcp:35:lfs.0 Request processed in 235us (400us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1790710858.244027:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 28 00010000:00010000:2.0:1790710858.247660:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790710858.360251:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710858.360496:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158158208 00000100:00100000:2.0:1790710858.360506:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158158208 00000100:00100000:2.0:1790710858.360565:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 104 00000100:00100000:2.0:1790710858.360575:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d03ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+51:10524:x1877696158158208:12345-192.168.206.46@tcp:101:bash.0 00010000:00010000:2.0:1790710858.360601:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790710858.360604:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1790710858.360629:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b281571442 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700055f expref: 51 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710858.360650:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c51c2c2ee00) 00010000:00010000:2.0:1790710858.360655:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790710858.360667:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046200/0xcbad34b2815714c7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b057000582 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710858.360770:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b2815714ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710858.360783:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b2815714ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710858.360794:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b2815714ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790710858.360804:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1790710858.360925:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046200/0xcbad34b2815714c7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000582 expref: 53 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710858.360940:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b2815714ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000582 expref: 52 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710858.360947:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c51e4efb800) 00010000:00010000:2.0:1790710858.360950:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790710858.360952:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c8047a00, rc 0) 00000100:00100000:2.0:1790710858.361012:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d03ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+52:10524:x1877696158158208:12345-192.168.206.46@tcp:101:bash.0 Request processed in 438us (770us total) trans 4294967393 rc 0/0 00000100:00100000:2.0:1790710858.361019:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 104 00000100:00100000:1.0:1790710858.365310:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710858.365389:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158158464 00000100:00100000:2.0:1790710858.365399:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158158464 00000100:00100000:2.0:1790710858.365455:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 105 00000100:00100000:2.0:1790710858.365465:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f457f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+52:10524:x1877696158158464:12345-192.168.206.46@tcp:36:bash.0 00010000:00010000:2.0:1790710858.365518:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1790710858.365557:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b2815714ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000582 expref: 52 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710858.365577:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b000/0xcbad34b2815714b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700057b expref: 51 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710858.365588:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c51e4efb800) 00010000:00010000:2.0:1790710858.365594:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790710858.365786:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b2815714dc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710858.365800:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b2815714dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710858.365810:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b2815714dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790710858.365860:0:5847:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967394 00000004:00010000:2.0:1790710858.365885:0:5847:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000d5f966df reply state 00000000fbd33115 transno 4294967395 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b2815714dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710858.365894:0:5847:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790710858.365984:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f457f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+53:10524:x1877696158158464:12345-192.168.206.46@tcp:36:bash.0 Request processed in 520us (682us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1790710858.365992:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 105 00000020:00080000:2.0:1790710858.365997:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1790710858.368821:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00010000:00010000:2.0:1790710858.368902:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b2815714dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710858.368915:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b2815714dc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710858.368939:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b2815714dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710858.368945:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c8047800 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1790710858.368950:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b2815714dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710858.368959:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b2815714dc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710858.368974:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c51e4efb800) 00010000:00010000:2.0:1790710858.368977:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790710858.368982:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b2815714dc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710858.368988:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b2815714dc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710858.369785:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158158592 00000100:00100000:0.0:1790710858.369797:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158158592 00000100:00100000:0.0:1790710858.369854:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 106 00000100:00100000:0.0:1790710858.369863:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f457e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+52:10524:x1877696158158592:12345-192.168.206.46@tcp:101:bash.0 00010000:00010000:0.0:1790710858.369886:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790710858.369903:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b200/0xcbad34b2815714e3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b057000589 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710858.369968:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ac00/0xcbad34b2815714ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710858.369991:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ac00/0xcbad34b2815714ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710858.370001:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ac00/0xcbad34b2815714ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790710858.370024:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1790710858.370028:0:5845:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790710858.370043:0:5845:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ac00/0xcbad34b2815714ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710858.370076:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b200/0xcbad34b2815714e3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000589 expref: 54 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710858.370091:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ac00/0xcbad34b2815714ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000589 expref: 53 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710858.370099:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c51e4efb800) 00010000:00010000:0.0:1790710858.370102:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790710858.370104:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c243ac00, rc 0) 00000100:00100000:0.0:1790710858.370189:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f457e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+53:10524:x1877696158158592:12345-192.168.206.46@tcp:101:bash.0 Request processed in 326us (1378us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710858.370204:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 106 00000100:00100000:1.0:1790710858.373630:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710858.373701:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158158848 00000100:00100000:0.0:1790710858.373710:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158158848 00000100:00100000:0.0:1790710858.373759:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 29 00000100:00100000:0.0:1790710858.373768:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f457ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+53:10524:x1877696158158848:12345-192.168.206.46@tcp:35:bash.0 00000100:00100000:0.0:1790710858.373973:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f457ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+54:10524:x1877696158158848:12345-192.168.206.46@tcp:35:bash.0 Request processed in 205us (349us total) trans 4294967396 rc 0/0 00000100:00100000:0.0:1790710858.373991:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 29 00000100:00100000:1.0:1790710858.427792:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710858.427886:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158158976 00000100:00100000:2.0:1790710858.427901:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158158976 00000100:00100000:2.0:1790710858.427974:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 107 00000100:00100000:2.0:1790710858.427984:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f457c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+54:10530:x1877696158158976:12345-192.168.206.46@tcp:101:lfs.0 00010000:00010000:2.0:1790710858.428008:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790710858.428029:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b2815714f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b057000590 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710858.428092:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b2815714f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710858.428106:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b2815714f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710858.428174:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b2815714f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790710858.428220:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1790710858.428225:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790710858.428241:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b2815714f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710858.428263:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b2815714f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000590 expref: 56 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710858.428280:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b2815714f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000590 expref: 55 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710858.428288:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c51c2c2ee00) 00010000:00010000:2.0:1790710858.428290:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790710858.428293:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c8047a00, rc 0) 00000100:00100000:2.0:1790710858.428352:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f457c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+55:10530:x1877696158158976:12345-192.168.206.46@tcp:101:lfs.0 Request processed in 370us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710858.428359:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 107 00000100:00100000:1.0:1790710858.430897:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710858.433333:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158159104 00000100:00100000:0.0:1790710858.433350:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158159104 00000100:00100000:0.0:1790710858.433421:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 108 00000100:00100000:0.0:1790710858.433432:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f457dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+55:10530:x1877696158159104:12345-192.168.206.46@tcp:101:lfs.0 00010000:00010000:0.0:1790710858.433452:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790710858.433472:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b200/0xcbad34b2815714ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b057000597 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710858.433535:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243aa00/0xcbad34b281571506 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710858.433551:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243aa00/0xcbad34b281571506 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710858.433562:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243aa00/0xcbad34b281571506 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710858.433576:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243a800/0xcbad34b28157150d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710858.433582:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243a800/0xcbad34b28157150d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710858.433588:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243a800/0xcbad34b28157150d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710858.433666:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b600/0xcbad34b281571514 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710858.433688:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b600/0xcbad34b281571514 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710858.433695:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b600/0xcbad34b281571514 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790710858.433726:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1790710858.433730:0:5845:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790710858.433746:0:5845:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b600/0xcbad34b281571514 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710858.433757:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b600/0xcbad34b281571514 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710858.433765:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243aa00/0xcbad34b281571506 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710858.433770:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243aa00/0xcbad34b281571506 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710858.433776:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243aa00/0xcbad34b281571506 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710858.433782:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c243aa00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1790710858.433786:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243aa00/0xcbad34b281571506 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710858.433794:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243aa00/0xcbad34b281571506 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710858.433806:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c51c2c2ee00) 00010000:00010000:0.0:1790710858.433809:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790710858.433821:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243aa00/0xcbad34b281571506 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710858.433827:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243aa00/0xcbad34b281571506 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710858.433840:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243a800/0xcbad34b28157150d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710858.433846:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243a800/0xcbad34b28157150d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710858.433852:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243a800/0xcbad34b28157150d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710858.433857:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c243a800 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1790710858.433860:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243a800/0xcbad34b28157150d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710858.433865:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243a800/0xcbad34b28157150d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710858.433872:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c51e4efbc00) 00010000:00010000:0.0:1790710858.433875:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790710858.433878:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243a800/0xcbad34b28157150d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710858.433883:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243a800/0xcbad34b28157150d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710858.433911:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b200/0xcbad34b2815714ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000597 expref: 57 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710858.433940:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b600/0xcbad34b281571514 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000597 expref: 56 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710858.433947:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c51e4efb800) 00010000:00010000:0.0:1790710858.433950:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790710858.433952:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c243b600, rc 0) 00000100:00100000:0.0:1790710858.434007:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f457dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+56:10530:x1877696158159104:12345-192.168.206.46@tcp:101:lfs.0 Request processed in 577us (3122us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710858.434015:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 108 00000100:00100000:1.0:1790710858.438191:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710858.438291:0:8449:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158159232 00000100:00100000:3.0:1790710858.438300:0:8449:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158159232 00000100:00100000:3.0:1790710858.438357:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 7 00000100:00100000:3.0:1790710858.438367:0:8449:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f457c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+56:2357:x1877696158159232:12345-192.168.206.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790710858.438381:0:8449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790710858.438403:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b600/0xcbad34b281571514 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000597 expref: 56 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710858.438421:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c51e4efb800) 00010000:00010000:3.0:1790710858.438426:0:8449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790710858.438478:0:8449:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f457c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+55:2357:x1877696158159232:12345-192.168.206.46@tcp:103:ldlm_bl.0 Request processed in 112us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710858.438500:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 7 00000100:00100000:1.0:1790710858.441107:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710858.441238:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158159488 00000100:00100000:2.0:1790710858.441248:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158159488 00000100:00100000:2.0:1790710858.441304:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 109 00000100:00100000:2.0:1790710858.441314:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f457df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+55:10530:x1877696158159488:12345-192.168.206.46@tcp:101:lfs.0 00010000:00010000:2.0:1790710858.441335:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790710858.441355:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046200/0xcbad34b28157151b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b05700059e expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710858.441469:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b281571522 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710858.441484:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ac00/0xcbad34b2815714ea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000589 expref: 56 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710858.441492:0:5847:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b281571522 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710858.441525:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ac00/0xcbad34b2815714ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.46@tcp remote: 0x566877b057000589 expref: 56 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710858.441538:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ac00/0xcbad34b2815714ea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000589 expref: 56 pid: 5845 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710858.441552:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51fa2cf800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1877696177047936:192.168.206.46@tcp:104: 00000100:00100000:2.0:1790710858.441641:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51d8a96180 going to sleep for 11 seconds 00000100:00100000:2.0:1790710858.444579:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51fa2cf800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1877696177047936:192.168.206.46@tcp:104: 00010000:00010000:2.0:1790710858.444611:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b281571522 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710858.456166:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710858.456263:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158159616 00000100:00100000:2.0:1790710858.456274:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158159616 00010000:00010000:2.0:1790710858.456327:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ac00/0xcbad34b2815714ea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000589 expref: 57 pid: 5845 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710858.456362:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 52 00000100:00100000:2.0:1790710858.456384:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f457fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+57:2358:x1877696158159616:12345-192.168.206.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790710858.456399:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790710858.456406:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ac00/0xcbad34b2815714ea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000589 expref: 57 pid: 5845 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710858.456418:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ac00/0xcbad34b2815714ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000589 expref: 57 pid: 5845 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710858.456437:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ac00/0xcbad34b2815714ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000589 expref: 57 pid: 5845 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710858.456453:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c51e4efb800) 00010000:00010000:2.0:1790710858.456458:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b281571522 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710858.456468:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b281571522 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710858.456475:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b281571522 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710858.456512:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790710858.456570:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f457fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+56:2358:x1877696158159616:12345-192.168.206.46@tcp:103:ldlm_bl.0 Request processed in 187us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710858.456579:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 52 00010000:00010000:0.0:1790710858.456642:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b281571522 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710858.456651:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b281571522 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790710858.456669:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1790710858.456824:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046200/0xcbad34b28157151b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700059e expref: 57 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710858.456843:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b281571522 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700059e expref: 56 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710858.456850:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c51e4efb800) 00010000:00010000:0.0:1790710858.456852:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790710858.456855:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c8046800, rc 0) 00000100:00100000:0.0:1790710858.456881:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f457df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+56:10530:x1877696158159488:12345-192.168.206.46@tcp:101:lfs.0 Request processed in 15569us (15783us total) trans 4294967397 rc 0/0 00000100:00100000:0.0:1790710858.456898:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 109 00000100:00100000:1.0:1790710858.463664:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710858.463743:0:8449:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158159872 00000100:00100000:3.0:1790710858.463753:0:8449:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158159872 00000100:00100000:3.0:1790710858.463858:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 8 00000100:00100000:3.0:1790710858.463869:0:8449:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f457ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+56:10530:x1877696158159872:12345-192.168.206.46@tcp:103:lfs.0 00010000:00010000:3.0:1790710858.463886:0:8449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790710858.463911:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243a400/0xcbad34b281571481 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000574 expref: 56 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710858.463929:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c51e4efb800) 00010000:00010000:3.0:1790710858.463934:0:8449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790710858.463992:0:8449:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f457ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+55:10530:x1877696158159872:12345-192.168.206.46@tcp:103:lfs.0 Request processed in 125us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710858.463999:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 8 00000100:00100000:1.0:1790710858.472398:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710858.472627:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158160000 00000100:00100000:0.0:1790710858.472636:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158160000 00000100:00100000:0.0:1790710858.472688:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 110 00000100:00100000:0.0:1790710858.472697:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f457f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+55:10530:x1877696158160000:12345-192.168.206.46@tcp:58:lfs.0 00010000:00010000:0.0:1790710858.472782:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b200/0xcbad34b281571530 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710858.472800:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b200/0xcbad34b281571530 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710858.472811:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b200/0xcbad34b281571530 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790710858.472987:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:0.0:1790710858.473074:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f457f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+55:10530:x1877696158160000:12345-192.168.206.46@tcp:58:lfs.0 Request processed in 377us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710858.473083:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 110 00000100:00100000:1.0:1790710858.476897:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710858.476980:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158160128 00000100:00100000:3.0:1790710858.476989:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158160128 00000100:00100000:3.0:1790710858.477041:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 111 00000100:00100000:3.0:1790710858.477050:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f457d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+55:10530:x1877696158160128:12345-192.168.206.46@tcp:101:lfs.0 00010000:00010000:3.0:1790710858.477069:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790710858.477086:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645000/0xcbad34b281571537 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b0570005a5 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710858.477171:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b200/0xcbad34b281571530 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710858.477182:0:5846:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645000/0xcbad34b281571537 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570005a5 expref: 56 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710858.477224:0:5846:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b200/0xcbad34b281571530 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710858.477236:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645000/0xcbad34b281571537 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570005a5 expref: 56 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710858.477249:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c51e4efb800) 00010000:00010000:3.0:1790710858.477251:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790710858.477255:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645000/0xcbad34b281571537 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570005a5 expref: 56 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710858.477262:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c1645000, rc 0) 00000100:00100000:3.0:1790710858.477310:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f457d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+56:10530:x1877696158160128:12345-192.168.206.46@tcp:101:lfs.0 Request processed in 261us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710858.477317:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 111 00010000:00010000:1.0:1790710859.271289:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790710859.463411:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790710859.463419:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790710859.463489:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1790710859.463497:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790710859.463610:0:11676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51d03ef800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11676:1877696177048064:192.168.206.46@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1790710859.463718:0:11676:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51e4eacd80 going to sleep for 11 seconds 00000100:00100000:0.0:1790710859.471053:0:11676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51d03ef800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11676:1877696177048064:192.168.206.46@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790710859.478210:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710859.478528:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158160256 00000100:00100000:3.0:1790710859.478537:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158160256 00000100:00100000:3.0:1790710859.478681:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 112 00000100:00100000:3.0:1790710859.478692:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f457d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+56:10531:x1877696158160256:12345-192.168.206.46@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1790710859.478725:0:8060:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00080000:0.0:1790710859.478803:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790710859.479010:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f457d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+56:10531:x1877696158160256:12345-192.168.206.46@tcp:53:lhsmtool_posix.0 Request processed in 319us (819us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710859.479019:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 112 00000100:00100000:1.0:1790710859.486272:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710859.486470:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158160384 00000100:00100000:3.0:1790710859.486480:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158160384 00000100:00100000:3.0:1790710859.486534:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 113 00000100:00100000:3.0:1790710859.486558:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+56:10531:x1877696158160384:12345-192.168.206.46@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1790710859.486639:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645800/0xcbad34b28157153e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.486658:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645800/0xcbad34b28157153e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.486669:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645800/0xcbad34b28157153e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.486705:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281571545 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.486712:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281571545 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.486718:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281571545 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.486738:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b28157154c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.486746:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b28157154c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.486752:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b28157154c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790710859.486798:0:5846:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1790710859.486803:0:5846:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790710859.486815:0:5846:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b28157154c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.486838:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645800/0xcbad34b28157153e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.486845:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645800/0xcbad34b28157153e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.486852:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645800/0xcbad34b28157153e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.486857:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c1645800 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1790710859.486861:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645800/0xcbad34b28157153e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.486867:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645800/0xcbad34b28157153e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.486879:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c51cca25300) 00010000:00010000:3.0:1790710859.486882:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790710859.486886:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645800/0xcbad34b28157153e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.486891:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645800/0xcbad34b28157153e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.486903:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281571545 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.486909:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281571545 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.486914:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281571545 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.486924:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c1645200 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1790710859.486927:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281571545 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.486933:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281571545 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.486941:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9c51c2c2e200) 00010000:00010000:3.0:1790710859.486944:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790710859.486947:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281571545 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.486952:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281571545 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.486966:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b28157154c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.486972:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b28157154c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.486977:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b28157154c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.486982:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c1645c00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1790710859.486984:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b28157154c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.486990:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b28157154c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.487009:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c51e4efb800) 00010000:00010000:3.0:1790710859.487012:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790710859.487015:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b28157154c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.487470:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b28157154c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710859.487552:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+56:10531:x1877696158160384:12345-192.168.206.46@tcp:34:lhsmtool_posix.0 Request processed in 994us (1288us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710859.487560:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 113 00000100:00100000:1.0:1790710859.493644:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710859.493723:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158160640 00000100:00100000:2.0:1790710859.493732:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158160640 00000100:00100000:2.0:1790710859.493793:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 114 00000100:00100000:2.0:1790710859.493804:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+56:10531:x1877696158160640:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790710859.493838:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790710859.493858:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b281571553 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b0570005ac expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710859.493965:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047000/0xcbad34b28157155a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710859.493980:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047000/0xcbad34b28157155a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710859.493991:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047000/0xcbad34b28157155a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790710859.494001:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1790710859.494112:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047000/0xcbad34b28157155a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710859.494120:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047000/0xcbad34b28157155a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710859.494146:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047000/0xcbad34b28157155a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710859.494151:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c8047000 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1790710859.494155:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047000/0xcbad34b28157155a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710859.494161:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047000/0xcbad34b28157155a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710859.494171:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c51e4efb800) 00010000:00010000:2.0:1790710859.494181:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790710859.494186:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047000/0xcbad34b28157155a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710859.494205:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047000/0xcbad34b28157155a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710859.494239:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b281571553 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570005ac expref: 58 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710859.494249:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c51cca25300) 00010000:00010000:2.0:1790710859.494251:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790710859.494255:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b281571553 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570005ac expref: 58 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710859.494263:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c8047800, rc 0) 00000100:00100000:2.0:1790710859.494319:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+57:10531:x1877696158160640:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 Request processed in 518us (683us total) trans 4294967398 rc 301/301 00000100:00100000:2.0:1790710859.494326:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 114 00000100:00100000:1.0:1790710859.515385:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710859.515505:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158160768 00000100:00100000:0.0:1790710859.515536:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158160768 00000100:00100000:0.0:1790710859.515608:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 115 00000100:00100000:0.0:1790710859.515618:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9b04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+57:10531:x1877696158160768:12345-192.168.206.46@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1790710859.515665:0:5847:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1790710859.515817:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9b04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+57:10531:x1877696158160768:12345-192.168.206.46@tcp:53:lhsmtool_posix.0 Request processed in 191us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710859.515834:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 115 00000100:00100000:1.0:1790710859.519716:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710859.520091:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158161024 00000100:00100000:2.0:1790710859.520104:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158161024 00000100:00100000:2.0:1790710859.520205:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 116 00000100:00100000:2.0:1790710859.520216:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9b04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+57:10531:x1877696158161024:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790710859.520241:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790710859.520245:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1790710859.520278:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b2815714f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000590 expref: 57 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710859.520300:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c51c2c2ee00) 00010000:00010000:2.0:1790710859.520335:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790710859.520352:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b281571568 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b0570005b3 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790710859.520877:0:5845:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:2.0:1790710859.521092:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047000/0xcbad34b28157156f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710859.521107:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047000/0xcbad34b28157156f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710859.521119:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047000/0xcbad34b28157156f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710859.521253:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b281571568 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570005b3 expref: 59 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710859.521270:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047000/0xcbad34b28157156f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570005b3 expref: 58 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710859.521279:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c51cca25600) 00010000:00010000:2.0:1790710859.521282:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790710859.521285:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c8047000, rc 0) 00000100:00100000:2.0:1790710859.521371:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9b04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+58:10531:x1877696158161024:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 Request processed in 1157us (1668us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1790710859.521381:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 116 00000100:00100000:1.0:1790710859.530222:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710859.530344:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158161280 00000100:00100000:0.0:1790710859.530358:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158161280 00000100:00100000:0.0:1790710859.530427:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 117 00000100:00100000:0.0:1790710859.530437:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9b05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+58:10531:x1877696158161280:12345-192.168.206.46@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790710859.530509:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790710859.530540:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047000/0xcbad34b28157156f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570005b3 expref: 58 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.530563:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c51cca25600) 00010000:00010000:0.0:1790710859.530575:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790710859.530599:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243a800/0xcbad34b28157157d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.530614:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243a800/0xcbad34b28157157d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.530625:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243a800/0xcbad34b28157157d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.530639:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243aa00/0xcbad34b281571584 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x5f1f1155 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.530662:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243aa00/0xcbad34b281571584 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x5f1f1155 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.530669:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243aa00/0xcbad34b281571584 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x5f1f1155 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.530738:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243a800/0xcbad34b28157157d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.530746:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243a800/0xcbad34b28157157d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.530754:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243a800/0xcbad34b28157157d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.530760:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c243a800 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1790710859.530765:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243a800/0xcbad34b28157157d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.530773:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243a800/0xcbad34b28157157d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.530780:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c51c2c2ee00) 00010000:00010000:0.0:1790710859.530783:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790710859.530787:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243a800/0xcbad34b28157157d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.530793:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243a800/0xcbad34b28157157d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.530801:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243aa00/0xcbad34b281571584 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x5f1f1155 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.530812:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243aa00/0xcbad34b281571584 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x5f1f1155 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.530819:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243aa00/0xcbad34b281571584 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x5f1f1155 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.530823:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c243aa00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1790710859.530826:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243aa00/0xcbad34b281571584 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x5f1f1155 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.530832:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243aa00/0xcbad34b281571584 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x5f1f1155 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.530839:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x5f1f1155 (ffff9c51e4efbc00) 00010000:00010000:0.0:1790710859.530842:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790710859.530844:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243aa00/0xcbad34b281571584 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x5f1f1155 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.530850:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243aa00/0xcbad34b281571584 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x5f1f1155 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710859.530942:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9b05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+57:10531:x1877696158161280:12345-192.168.206.46@tcp:36:lhsmtool_posix.0 Request processed in 506us (732us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790710859.530949:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 117 00000100:00100000:1.0:1790710859.534878:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710859.535165:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158161408 00000100:00100000:3.0:1790710859.535180:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158161408 00000100:00100000:3.0:1790710859.535252:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 118 00000100:00100000:3.0:1790710859.535263:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f8ce7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+57:10531:x1877696158161408:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790710859.535288:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790710859.535316:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b28157158b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b0570005ba expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.535372:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281571592 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.535388:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281571592 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.535401:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281571592 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.535527:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b28157158b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570005ba expref: 59 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.535556:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281571592 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570005ba expref: 58 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.535565:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c51c2c2e200) 00010000:00010000:3.0:1790710859.535569:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790710859.535572:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c1645200, rc 0) 00000100:00100000:3.0:1790710859.535636:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f8ce7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+58:10531:x1877696158161408:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 Request processed in 375us (774us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710859.535644:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 118 00000100:00100000:1.0:1790710859.539854:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710859.539945:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158161664 00000100:00100000:0.0:1790710859.539960:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158161664 00000100:00100000:0.0:1790710859.540042:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 119 00000100:00100000:0.0:1790710859.540054:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f8ce4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+58:10531:x1877696158161664:12345-192.168.206.46@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790710859.540246:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243aa00/0xcbad34b281571599 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.540286:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243aa00/0xcbad34b281571599 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.540302:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243aa00/0xcbad34b281571599 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790710859.540644:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:0.0:1790710859.540655:0:5847:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 336877527139ns, next at 337877524485ns, rc = 0 00000004:00010000:0.0:1790710859.540754:0:5847:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000046ca2684 reply state 00000000b0ff124b transno 4294967400 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243aa00/0xcbad34b281571599 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710859.540764:0:5847:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790710859.540885:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f8ce4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+60:10531:x1877696158161664:12345-192.168.206.46@tcp:36:lhsmtool_posix.0 Request processed in 832us (1045us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1790710859.540893:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 119 00000100:00100000:1.0:1790710859.544463:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00010000:00010000:2.0:1790710859.544561:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243aa00/0xcbad34b281571599 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710859.544576:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243aa00/0xcbad34b281571599 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710859.544603:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243aa00/0xcbad34b281571599 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710859.544610:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c243aa00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1790710859.544615:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243aa00/0xcbad34b281571599 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710859.544625:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243aa00/0xcbad34b281571599 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710859.544644:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c51c2c2e200) 00010000:00010000:2.0:1790710859.544648:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790710859.544653:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243aa00/0xcbad34b281571599 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710859.544660:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243aa00/0xcbad34b281571599 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710859.544994:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158161792 00000100:00100000:3.0:1790710859.545007:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158161792 00000100:00100000:3.0:1790710859.545532:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 120 00000100:00100000:3.0:1790710859.545547:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f8ce6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+59:10531:x1877696158161792:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790710859.545584:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790710859.545606:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b2815715a0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b0570005c1 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.545682:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b2815715a0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570005c1 expref: 60 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.545699:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b2815715a0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570005c1 expref: 60 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.545721:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c51c2c2e200) 00010000:00010000:3.0:1790710859.545725:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790710859.545738:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c1645c00, rc 0) 00000100:00100000:3.0:1790710859.545875:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f8ce6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+60:10531:x1877696158161792:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 Request processed in 332us (1423us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710859.545884:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 120 00000100:00100000:1.0:1790710859.549695:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710859.550880:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158161920 00000100:00100000:2.0:1790710859.550898:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158161920 00000100:00100000:3.0:1790710859.551329:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 37 00000100:00100000:3.0:1790710859.551344:0:6696:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d032c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+8:2359:x1877696158161920:12345-192.168.206.46@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1790710859.551938:0:6696:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d032c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+9:2359:x1877696158161920:12345-192.168.206.46@tcp:2:lhsmtool_posix.0 Request processed in 595us (2254us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1790710859.551948:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 37 00000100:00080000:0.0:1790710859.552119:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790710859.556780:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710859.557086:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158162176 00000100:00100000:0.0:1790710859.557101:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158162176 00000100:00100000:0.0:1790710859.557212:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 30 00000100:00100000:0.0:1790710859.557224:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d032df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+60:10531:x1877696158162176:12345-192.168.206.46@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1790710859.557513:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d032df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+61:10531:x1877696158162176:12345-192.168.206.46@tcp:35:lhsmtool_posix.0 Request processed in 290us (745us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1790710859.557521:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 30 00000100:00100000:1.0:1790710859.560671:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710859.560876:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158162432 00000100:00100000:0.0:1790710859.560889:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158162432 00000100:00100000:0.0:1790710859.560963:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 121 00000100:00100000:0.0:1790710859.560974:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4e6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+61:10531:x1877696158162432:12345-192.168.206.46@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1790710859.562811:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4e6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+61:10531:x1877696158162432:12345-192.168.206.46@tcp:57:lhsmtool_posix.0 Request processed in 1819us (2135us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710859.562828:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 121 00000100:00100000:1.0:1790710859.566386:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710859.566485:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158162560 00000100:00100000:3.0:1790710859.566497:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158162560 00000100:00100000:3.0:1790710859.566675:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 122 00000100:00100000:3.0:1790710859.566688:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4e6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+61:10531:x1877696158162560:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790710859.566715:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790710859.566740:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645800/0xcbad34b2815715a7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b0570005c8 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.566842:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1644a00/0xcbad34b2815715ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.566860:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1644a00/0xcbad34b2815715ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.566874:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1644a00/0xcbad34b2815715ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790710859.566919:0:5845:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790710859.566941:0:5845:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1644a00/0xcbad34b2815715ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.566990:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645800/0xcbad34b2815715a7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570005c8 expref: 63 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.567010:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1644a00/0xcbad34b2815715ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570005c8 expref: 62 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.567020:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c51c2c2e200) 00010000:00010000:3.0:1790710859.567023:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1790710859.567028:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c1644a00, rc 0) 00000100:00100000:3.0:1790710859.567529:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4e6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+62:10531:x1877696158162560:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 Request processed in 841us (1208us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710859.567538:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 122 00000100:00100000:1.0:1790710859.570765:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710859.572420:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158162688 00000100:00100000:0.0:1790710859.572440:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158162688 00000100:00100000:0.0:1790710859.572685:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 38 00000100:00100000:0.0:1790710859.572697:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4e6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+9:2357:x1877696158162688:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790710859.572721:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790710859.572747:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7f82dca/0xcbad34b2815715b5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b0570005cf expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790710859.572782:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abc144b, blocks: 0x1 00010000:00010000:0.0:1790710859.572818:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=336s v=(0 0) 00010000:00010000:0.0:1790710859.572824:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790710859.572836:0:6698:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7f82dca/0xcbad34b2815715b5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570005cf expref: 10 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.572856:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e7f82dca/0xcbad34b2815715b5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570005cf expref: 10 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.572871:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c243a800, rc 0) 00000100:00100000:0.0:1790710859.572955:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4e6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+10:2357:x1877696158162688:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 Request processed in 260us (2204us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710859.572963:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 38 00000100:00100000:1.0:1790710859.577325:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710859.577488:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158162944 00000100:00100000:3.0:1790710859.577501:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158162944 00000100:00100000:3.0:1790710859.577583:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 123 00000100:00100000:3.0:1790710859.577594:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51fef71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+62:10531:x1877696158162944:12345-192.168.206.46@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1790710859.577738:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51fef71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+62:10531:x1877696158162944:12345-192.168.206.46@tcp:57:lhsmtool_posix.0 Request processed in 144us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710859.577746:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 123 00000100:00100000:1.0:1790710859.583865:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710859.584009:0:6696:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158163072 00000100:00100000:3.0:1790710859.584024:0:6696:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158163072 00000100:00100000:3.0:1790710859.584228:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 39 00000100:00100000:3.0:1790710859.584241:0:6696:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c75ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+10:10531:x1877696158163072:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790710859.584267:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790710859.584291:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000294c67b9/0xcbad34b2815715bc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b0570005d6 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.584351:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e7f82dca/0xcbad34b2815715b5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570005cf expref: 11 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.584361:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790710859.584365:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790710859.584371:0:6696:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000294c67b9/0xcbad34b2815715bc lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570005d6 expref: 11 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.584412:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e7f82dca/0xcbad34b2815715b5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.46@tcp remote: 0x566877b0570005cf expref: 11 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.584428:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e7f82dca/0xcbad34b2815715b5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570005cf expref: 11 pid: 6698 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710859.584446:0:6696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9767800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6696:1877696177048192:192.168.206.46@tcp:104: 00000100:00100000:3.0:1790710859.584936:0:6696:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c8dc7900 going to sleep for 11 seconds 00000100:00100000:3.0:1790710859.593268:0:6696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9767800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6696:1877696177048192:192.168.206.46@tcp:104: 00010000:00010000:3.0:1790710859.593334:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000294c67b9/0xcbad34b2815715bc lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.46@tcp remote: 0x566877b0570005d6 expref: 11 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.593360:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c1645800, rc 0) 00000100:00100000:3.0:1790710859.593435:0:6696:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c75ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+11:10531:x1877696158163072:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 Request processed in 9195us (9584us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710859.593445:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 39 00000100:00100000:1.0:1790710859.596249:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710859.596450:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158163200 00000100:00100000:2.0:1790710859.596462:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158163200 00010000:00010000:2.0:1790710859.596660:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e7f82dca/0xcbad34b2815715b5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570005cf expref: 11 pid: 6698 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710859.596713:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 53 00000100:00100000:2.0:1790710859.596725:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8e5f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+11:2358:x1877696158163200:12345-192.168.206.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790710859.596745:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790710859.596776:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e7f82dca/0xcbad34b2815715b5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570005cf expref: 11 pid: 6698 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710859.596821:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e7f82dca/0xcbad34b2815715b5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570005cf expref: 11 pid: 6698 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710859.596850:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7f82dca/0xcbad34b2815715b5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570005cf expref: 11 pid: 6698 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710859.596869:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790710859.596873:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790710859.596882:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000294c67b9/0xcbad34b2815715bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.46@tcp remote: 0x566877b0570005d6 expref: 10 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710859.596893:0:5831:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000294c67b9/0xcbad34b2815715bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.46@tcp remote: 0x566877b0570005d6 expref: 10 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710859.596942:0:5831:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000294c67b9/0xcbad34b2815715bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.46@tcp remote: 0x566877b0570005d6 expref: 10 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710859.596957:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51fa2cf800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5831:1877696177048320:192.168.206.46@tcp:105: 00000100:00100000:2.0:1790710859.597454:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51d8a96e40 going to sleep for 11 seconds 00000100:00100000:2.0:1790710859.605921:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51fa2cf800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5831:1877696177048320:192.168.206.46@tcp:105: 00010000:00010000:2.0:1790710859.605963:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790710859.606044:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8e5f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+10:2358:x1877696158163200:12345-192.168.206.46@tcp:103:ldlm_bl.0 Request processed in 9311us (9796us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710859.606066:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 53 00000100:00100000:1.0:1790710859.610466:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710859.610743:0:6703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158163328 00000100:00100000:2.0:1790710859.610756:0:6703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158163328 00002000:00100000:2.0:1790710859.610836:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9c51c75ddf80 x1877696158163328/t0(0) o4->0ec73bd1-726e-4dc0-8edd-807d3f973d65@192.168.206.46@tcp:360/0 lens 504/0 e 0 to 0 dl 1790710870 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790710859.610849:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c51c75ddf80 with x1877696158163328 ext(0->12) 00002000:00010000:2.0:1790710859.610858:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c51c75ddf80 00000100:00100000:2.0:1790710859.610895:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 2 00000100:00100000:2.0:1790710859.610906:0:6703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c75ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+10:2359:x1877696158163328:12345-192.168.206.46@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1790710859.612069:0:6703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c75ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+12:2359:x1877696158163328:12345-192.168.206.46@tcp:4:lhsmtool_posix.0 Request processed in 1156us (1608us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1790710859.612081:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 2 00002000:00100000:2.0:1790710859.612092:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9c51c75ddf80 x1877696158163328/t4294967308(0) o4->0ec73bd1-726e-4dc0-8edd-807d3f973d65@192.168.206.46@tcp:360/0 lens 504/448 e 0 to 0 dl 1790710870 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790710859.612103:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c51c75ddf80 with x1877696158163328 ext(0->12) 00002000:00010000:2.0:1790710859.612109:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c51c75ddf80 00000100:00100000:1.0:1790710859.619685:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710859.626998:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158163456 00000100:00100000:0.0:1790710859.627096:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158163456 00000100:00100000:3.0:1790710859.627354:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 124 00000100:00100000:3.0:1790710859.627369:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c75df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+62:10531:x1877696158163456:12345-192.168.206.46@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1790710859.665556:0:5867:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967401 is committed 00000004:00080000:2.0:1790710859.665577:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:2.0:1790710859.665643:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:2.0:1790710859.665655:0:5867:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c51f4ecfd80 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1790710859.665660:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c51c8e99800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c51f4ecf300 00000020:00080000:2.0:1790710859.665663:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c51c8e99000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c51ff16bc00 00000004:00080000:2.0:1790710859.665690:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:2.0:1790710859.665706:0:5867:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c51f956de40 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:2.0:1790710859.665709:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c51c8097400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c51f956d9c0 00000020:00080000:2.0:1790710859.665730:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c51c8097700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c51f9f03c00 00000020:00080000:2.0:1790710859.666032:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000100:00100000:0.0:1790710859.666158:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51fa2cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1877696177048448:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1790710859.666256:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710859.666321:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790710859.666327:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51fa2ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1877696177048576:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1790710859.666349:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710859.666380:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177048448 00000100:00100000:0.0:1790710859.666389:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177048448 00000100:00100000:0.0:1790710859.666445:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177048576 00000100:00100000:0.0:1790710859.666448:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177048576 00000100:00100000:0.0:1790710859.666465:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790710859.666474:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d03ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3309:x1877696177048448:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1790710859.666506:0:6698:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:0.0:1790710859.666538:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000afd19897/0xcbad34b2815715c3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.666564:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008cdb18a6/0xcbad34b281571385 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.46@tcp remote: 0x566877b057000535 expref: 11 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.666575:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=3s v=(0 0) 00010000:00010000:0.0:1790710859.666580:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790710859.666585:0:6698:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000afd19897/0xcbad34b2815715c3 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.666617:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008cdb18a6/0xcbad34b281571385 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.46@tcp remote: 0x566877b057000535 expref: 11 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.666632:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008cdb18a6/0xcbad34b281571385 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.46@tcp remote: 0x566877b057000535 expref: 11 pid: 6698 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710859.666654:0:6698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51d03eea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1877696177048704:192.168.206.46@tcp:104: 00000100:00100000:0.0:1790710859.666723:0:6698:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51e4eac3c0 going to sleep for 11 seconds 00000100:00080000:0.0:1790710859.666736:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00080000:2.0:1790710859.667628:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1790710859.669791:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51fa2cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177048832:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1790710859.669893:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710859.670180:0:6697:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1790710859.670363:0:6697:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1790710859.670745:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177048832 00000100:00100000:2.0:1790710859.670756:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177048832 00000100:00100000:0.0:1790710859.671006:0:12058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1790710859.671019:0:12058:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d03ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3309:x1877696177048576:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1790710859.671625:0:12058:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1790710859.671632:0:12058:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1790710859 00002000:00010000:0.0:1790710859.671634:0:12058:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1790710859.671637:0:12058:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1790710859 -> 1790710859 00002000:00010000:0.0:1790710859.671640:0:12058:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1790710859.671736:0:12058:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d03ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3309:x1877696177048576:12345-0@lo:2:osp-syn-1-0.0 Request processed in 719us (5383us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1790710859.671745:0:12058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1790710859.671771:0:12058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1790710859.671780:0:12058:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c812ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3311:x1877696177048832:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1790710859.671798:0:12058:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00000004:00080000:1.0:1790710859.672990:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c51fa2ce300/2, rc 0, transno 4294967309 00000100:00100000:1.0:1790710859.673004:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51fa2ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1877696177048576:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1790710859.673369:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c75df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+15:10531:x1877696158163456:12345-192.168.206.46@tcp:44:lhsmtool_posix.0 Request processed in 46000us (53694us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710859.673380:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 124 00002000:00010000:0.0:1790710859.673507:0:12058:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6abc1449, atime: 0x6abc1449, ctime: 0x6abc1449, blocks: 0x1 00010000:00010000:0.0:1790710859.673517:0:12058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000646b643/0xcbad34b2815715ca lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.673536:0:12058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=337s v=(0 0) 00010000:00010000:0.0:1790710859.673541:0:12058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790710859.673549:0:12058:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000646b643/0xcbad34b2815715ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.673592:0:12058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000646b643/0xcbad34b2815715ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.673604:0:12058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000646b643/0xcbad34b2815715ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.673613:0:12058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000646b643/0xcbad34b2815715ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.673638:0:12058:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1790710859.674333:0:12058:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c812ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3311:x1877696177048832:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2552us (4437us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1790710859.674344:0:12058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000004:00080000:0.0:1790710859.674401:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c51fa2cea00/2, rc 0, transno 4294967304 00000100:00100000:0.0:1790710859.674408:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51fa2cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177048832:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1790710859.674563:0:8509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790710859.674573:0:8509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000646b643/0xcbad34b2815715ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.674584:0:8509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c243aa00 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:3.0:1790710859.674590:0:8509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000646b643/0xcbad34b2815715ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.674602:0:8509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000646b643/0xcbad34b2815715ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.674624:0:8509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000646b643/0xcbad34b2815715ca lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.674632:0:8509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000646b643/0xcbad34b2815715ca lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.674654:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790710859.674656:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790710859.674658:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790710859.677073:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710859.677117:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158163584 00000100:00100000:2.0:1790710859.677145:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158163584 00010000:00010000:2.0:1790710859.677207:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008cdb18a6/0xcbad34b281571385 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.46@tcp remote: 0x566877b057000535 expref: 12 pid: 6698 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710859.677250:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 54 00000100:00100000:2.0:1790710859.677259:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51fa2cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+12:2358:x1877696158163584:12345-192.168.206.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790710859.677278:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790710859.677285:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008cdb18a6/0xcbad34b281571385 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.46@tcp remote: 0x566877b057000535 expref: 12 pid: 6698 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710859.677300:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008cdb18a6/0xcbad34b281571385 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.46@tcp remote: 0x566877b057000535 expref: 12 pid: 6698 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710859.677332:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790710859.677337:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790710859.677344:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000afd19897/0xcbad34b2815715c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710859.677379:0:5830:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000afd19897/0xcbad34b2815715c3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710859.677403:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790710859.677457:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51fa2cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+12:2358:x1877696158163584:12345-192.168.206.46@tcp:103:ldlm_bl.0 Request processed in 199us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710859.677465:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 54 00010000:00010000:3.0:1790710859.677641:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008cdb18a6/0xcbad34b281571385 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.46@tcp remote: 0x566877b057000535 expref: 11 pid: 6698 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710859.677672:0:6698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51d03eea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1877696177048704:192.168.206.46@tcp:104: 00010000:00010000:3.0:1790710859.677697:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000afd19897/0xcbad34b2815715c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.677709:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000afd19897/0xcbad34b2815715c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.677716:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000afd19897/0xcbad34b2815715c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.677727:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000afd19897/0xcbad34b2815715c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.677736:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000afd19897/0xcbad34b2815715c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.677760:0:6698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1790710859.678419:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d03ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3309:x1877696177048448:12345-0@lo:6:osp-syn-1-0.0 Request processed in 11943us (12160us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1790710859.678430:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000004:00080000:3.0:1790710859.678489:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c51fa2cf800/2, rc 0, transno 4294967310 00000100:00100000:3.0:1790710859.678496:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51fa2cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1877696177048448:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1790710859.678700:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790710859.678709:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000afd19897/0xcbad34b2815715c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710859.678720:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c243a000 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:2.0:1790710859.678725:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000afd19897/0xcbad34b2815715c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710859.678736:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000afd19897/0xcbad34b2815715c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710859.678755:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000afd19897/0xcbad34b2815715c3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710859.678763:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000afd19897/0xcbad34b2815715c3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710859.678784:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710859.678795:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710859.678797:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790710859.681710:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710859.681797:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158163712 00000100:00100000:2.0:1790710859.681809:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158163712 00000100:00100000:2.0:1790710859.681977:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 43 00000100:00100000:2.0:1790710859.681989:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d03ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+11:2358:x1877696158163712:12345-192.168.206.46@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1790710859.711529:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d03ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+11:2358:x1877696158163712:12345-192.168.206.46@tcp:16:lhsmtool_posix.0 Request processed in 29526us (29816us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710859.711547:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 43 00000001:00080000:0.0:1790710859.713490:0:7643:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:0.0:1790710859.713521:0:7643:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:0.0:1790710859.713535:0:7643:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000100:00100000:1.0:1790710859.714639:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710859.714735:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158163968 00000100:00100000:3.0:1790710859.714747:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158163968 00000100:00100000:3.0:1790710859.714837:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 125 00000100:00100000:3.0:1790710859.714848:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c812f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+15:10531:x1877696158163968:12345-192.168.206.46@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790710859.714920:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790710859.714956:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1644a00/0xcbad34b2815715ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570005c8 expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.714981:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c51c2c2e200) 00010000:00010000:3.0:1790710859.714987:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790710859.715023:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645e00/0xcbad34b2815715d1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.715270:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645e00/0xcbad34b2815715d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.715282:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645e00/0xcbad34b2815715d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790710859.715585:0:5846:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000f7477de0 reply state 0000000016f93ac4 transno 4294967402 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645e00/0xcbad34b2815715d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710859.715596:0:5846:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790710859.715709:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c812f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+16:10531:x1877696158163968:12345-192.168.206.46@tcp:36:lhsmtool_posix.0 Request processed in 862us (1080us total) trans 4294967402 rc 0/0 00000100:00100000:3.0:1790710859.715718:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 125 00010000:00010000:0.0:1790710859.717643:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645e00/0xcbad34b2815715d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.717664:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645e00/0xcbad34b2815715d1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.717673:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645e00/0xcbad34b2815715d1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.717697:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c1645e00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1790710859.717703:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645e00/0xcbad34b2815715d1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.717712:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645e00/0xcbad34b2815715d1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.717729:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c51c2c2e200) 00010000:00010000:0.0:1790710859.717732:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790710859.717737:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645e00/0xcbad34b2815715d1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.717743:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645e00/0xcbad34b2815715d1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710859.719197:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710859.719479:0:12058:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158164096 00000100:00100000:0.0:1790710859.719492:0:12058:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158164096 00000100:00100000:0.0:1790710859.719561:0:12058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 44 00000100:00100000:0.0:1790710859.719571:0:12058:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9ca1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:2358:x1877696158164096:12345-192.168.206.46@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1790710859.719870:0:12058:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1790710859.719875:0:12058:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1790710859 -> 1790710858 00002000:00010000:0.0:1790710859.719877:0:12058:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1790710857 00002000:00010000:0.0:1790710859.719879:0:12058:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1790710859 -> 1790710858 00002000:00010000:0.0:1790710859.719882:0:12058:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1790710859.719967:0:12058:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9ca1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+7:2358:x1877696158164096:12345-192.168.206.46@tcp:2:lhsmtool_posix.0 Request processed in 396us (790us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1790710859.719976:0:12058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 44 00000100:00100000:2.0:1790710859.723346:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710859.723437:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158164352 00000100:00100000:0.0:1790710859.723465:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158164352 00000100:00100000:0.0:1790710859.723539:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 126 00000100:00100000:0.0:1790710859.723551:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51fa2cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+15:10531:x1877696158164352:12345-192.168.206.46@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1790710859.723642:0:8060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ac00/0xcbad34b2815715d8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.723664:0:8060:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281571592 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570005ba expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.723675:0:8060:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ac00/0xcbad34b2815715d8 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.723718:0:8060:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281571592 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.46@tcp remote: 0x566877b0570005ba expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.723734:0:8060:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281571592 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570005ba expref: 15 pid: 5845 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710859.723751:0:8060:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51d03edc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8060:1877696177048960:192.168.206.46@tcp:104: 00000100:00100000:0.0:1790710859.723873:0:8060:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51e4eac600 going to sleep for 11 seconds 00000100:00100000:0.0:1790710859.726380:0:8060:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51d03edc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8060:1877696177048960:192.168.206.46@tcp:104: 00010000:00010000:0.0:1790710859.726417:0:8060:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ac00/0xcbad34b2815715d8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710859.728115:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710859.728529:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158164480 00000100:00100000:3.0:1790710859.728542:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158164480 00010000:00010000:3.0:1790710859.728593:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281571592 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570005ba expref: 16 pid: 5845 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710859.728641:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 55 00000100:00100000:3.0:1790710859.728669:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51fa2cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+16:2359:x1877696158164480:12345-192.168.206.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790710859.728690:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790710859.728699:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281571592 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570005ba expref: 16 pid: 5845 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.728714:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281571592 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570005ba expref: 16 pid: 5845 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.728741:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281571592 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570005ba expref: 16 pid: 5845 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.728762:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c51c2c2e200) 00010000:00010000:3.0:1790710859.728767:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ac00/0xcbad34b2815715d8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.728779:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ac00/0xcbad34b2815715d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.728787:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ac00/0xcbad34b2815715d8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.728833:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790710859.728907:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51fa2cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+15:2359:x1877696158164480:12345-192.168.206.46@tcp:103:ldlm_bl.0 Request processed in 239us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710859.728915:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 55 00010000:00010000:0.0:1790710859.729270:0:8060:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ac00/0xcbad34b2815715d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.729281:0:8060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ac00/0xcbad34b2815715d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.729331:0:8060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ac00/0xcbad34b2815715d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.729340:0:8060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ac00/0xcbad34b2815715d8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.729347:0:8060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ac00/0xcbad34b2815715d8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.729354:0:8060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c243ac00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1790710859.729359:0:8060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ac00/0xcbad34b2815715d8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.729369:0:8060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ac00/0xcbad34b2815715d8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.729379:0:8060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c51c2c2e200) 00010000:00010000:0.0:1790710859.729383:0:8060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1790710859.729387:0:8060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ac00/0xcbad34b2815715d8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.729393:0:8060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ac00/0xcbad34b2815715d8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710859.729459:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51fa2cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+14:10531:x1877696158164352:12345-192.168.206.46@tcp:55:lhsmtool_posix.0 Request processed in 5910us (6125us total) trans 0 rc -22/-22 00000100:00100000:0.0:1790710859.729468:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 126 00000100:00100000:2.0:1790710859.732956:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710859.733073:0:6696:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158164608 00000100:00100000:3.0:1790710859.733085:0:6696:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158164608 00000100:00100000:3.0:1790710859.733200:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 45 00000100:00100000:3.0:1790710859.733211:0:6696:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51fa2cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+7:2359:x1877696158164608:12345-192.168.206.46@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1790710859.733289:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004c6f26ee/0xcbad34b2815715df lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.733316:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000294c67b9/0xcbad34b2815715bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.46@tcp remote: 0x566877b0570005d6 expref: 7 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.733326:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1790710859.733331:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790710859.733337:0:6696:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004c6f26ee/0xcbad34b2815715df lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.733381:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000294c67b9/0xcbad34b2815715bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.46@tcp remote: 0x566877b0570005d6 expref: 7 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.733396:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000294c67b9/0xcbad34b2815715bc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.46@tcp remote: 0x566877b0570005d6 expref: 7 pid: 6696 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710859.733412:0:6696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9767800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6696:1877696177049088:192.168.206.46@tcp:104: 00000100:00100000:3.0:1790710859.733514:0:6696:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c8dc7900 going to sleep for 11 seconds 00000100:00100000:3.0:1790710859.735585:0:6696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9767800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6696:1877696177049088:192.168.206.46@tcp:104: 00010000:00010000:3.0:1790710859.735624:0:6696:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004c6f26ee/0xcbad34b2815715df lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710859.736281:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710859.736329:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158164736 00000100:00100000:0.0:1790710859.736337:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158164736 00010000:00010000:0.0:1790710859.736381:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000294c67b9/0xcbad34b2815715bc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.46@tcp remote: 0x566877b0570005d6 expref: 8 pid: 6696 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710859.736448:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 56 00000100:00100000:0.0:1790710859.736458:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51fa2cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+8:2358:x1877696158164736:12345-192.168.206.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790710859.736476:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790710859.736505:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000294c67b9/0xcbad34b2815715bc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.46@tcp remote: 0x566877b0570005d6 expref: 8 pid: 6696 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.736519:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000294c67b9/0xcbad34b2815715bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.46@tcp remote: 0x566877b0570005d6 expref: 8 pid: 6696 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.736546:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000294c67b9/0xcbad34b2815715bc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.46@tcp remote: 0x566877b0570005d6 expref: 8 pid: 6696 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.736565:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790710859.736570:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790710859.736576:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004c6f26ee/0xcbad34b2815715df lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.736587:0:5830:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004c6f26ee/0xcbad34b2815715df lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.736622:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790710859.736646:0:6696:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004c6f26ee/0xcbad34b2815715df lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710859.736655:0:6696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004c6f26ee/0xcbad34b2815715df lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710859.736682:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004c6f26ee/0xcbad34b2815715df lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710859.736686:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51fa2cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+7:2358:x1877696158164736:12345-192.168.206.46@tcp:103:ldlm_bl.0 Request processed in 228us (407us total) trans 0 rc 0/0 00010000:00010000:2.0:1790710859.736692:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004c6f26ee/0xcbad34b2815715df lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710859.736693:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 56 00010000:00010000:2.0:1790710859.736700:0:6696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004c6f26ee/0xcbad34b2815715df lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710859.736719:0:6696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c1644a00 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:2.0:1790710859.736724:0:6696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004c6f26ee/0xcbad34b2815715df lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710859.736735:0:6696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004c6f26ee/0xcbad34b2815715df lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710859.736748:0:6696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004c6f26ee/0xcbad34b2815715df lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710859.736755:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004c6f26ee/0xcbad34b2815715df lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710859.736821:0:6696:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51fa2cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:2359:x1877696158164608:12345-192.168.206.46@tcp:1:lhsmtool_posix.0 Request processed in 3613us (3878us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710859.736829:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 45 00000100:00100000:1.0:1790710859.739728:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710859.739794:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158164992 00000100:00100000:2.0:1790710859.739806:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158164992 00000100:00100000:2.0:1790710859.739875:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 127 00000100:00100000:2.0:1790710859.739886:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9ca2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+14:10531:x1877696158164992:12345-192.168.206.46@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1790710859.739981:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b2815715e6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710859.740002:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b2815715e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710859.740050:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b2815715e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710859.740409:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b2815715ed lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710859.740423:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b2815715a0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570005c1 expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710859.740432:0:5847:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b2815715ed lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710859.740473:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b2815715a0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.46@tcp remote: 0x566877b0570005c1 expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710859.740488:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b2815715a0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570005c1 expref: 15 pid: 5845 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710859.740504:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51fa2cfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1877696177049216:192.168.206.46@tcp:104: 00000100:00100000:2.0:1790710859.740611:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f956dc00 going to sleep for 11 seconds 00000100:00100000:1.0:1790710859.746885:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710859.746968:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158165120 00000100:00100000:3.0:1790710859.746981:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158165120 00000100:00100000:2.0:1790710859.747013:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51fa2cfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1877696177049216:192.168.206.46@tcp:104: 00010000:00010000:3.0:1790710859.747026:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b2815715a0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570005c1 expref: 16 pid: 5845 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710859.747045:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b2815715ed lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710859.747094:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 57 00000100:00100000:3.0:1790710859.747105:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4866300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+16:2358:x1877696158165120:12345-192.168.206.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790710859.747124:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790710859.747179:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b2815715a0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570005c1 expref: 16 pid: 5845 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.747203:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b2815715a0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570005c1 expref: 16 pid: 5845 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.747227:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b2815715a0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570005c1 expref: 16 pid: 5845 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.747244:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c51c2c2e200) 00010000:00010000:3.0:1790710859.747248:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b2815715ed lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.747259:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b2815715ed lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.747267:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b2815715ed lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.747295:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790710859.747333:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b2815715ed lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710859.747340:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b2815715ed lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790710859.747547:0:5847:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:2.0:1790710859.747830:0:5847:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:2.0:1790710859.747881:0:5847:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:2.0:1790710859.747981:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51fa2cfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5847:1877696177049344:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1790710859.748062:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710859.748102:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51d8a96c00 going to sleep for 11 seconds 00000100:00100000:3.0:1790710859.748235:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177049344 00000100:00100000:3.0:1790710859.748241:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177049344 00000100:00100000:0.0:1790710859.748268:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4866300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+18:2358:x1877696158165120:12345-192.168.206.46@tcp:103:ldlm_bl.0 Request processed in 1162us (1395us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710859.748278:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 57 00000100:00100000:3.0:1790710859.748281:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790710859.748288:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f457ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5847:x1877696177049344:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1790710859.748403:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f457ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5847:x1877696177049344:12345-0@lo:1000:mdt00_002.0 Request processed in 115us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710859.748410:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790710859.748883:0:5847:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1790710859.748891:0:5847:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967310 00000004:00080000:0.0:1790710859.748912:0:5847:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c51fa2ce300, transno 4294967309 00000004:00080000:0.0:1790710859.748927:0:5847:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c51fa2cf800, transno 4294967310 00000100:00100000:0.0:1790710859.748936:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51fa2cfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5847:1877696177049344:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1790710859.749515:0:5847:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:0.0:1790710859.750987:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51d03edc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5847:1877696177049472:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1790710859.751678:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710859.751782:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51e4eac3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790710859.751972:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177049472 00000100:00100000:3.0:1790710859.751981:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177049472 00000100:00100000:3.0:1790710859.752246:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790710859.752259:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d03ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5847:x1877696177049472:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1790710859.753060:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d03ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5847:x1877696177049472:12345-0@lo:1000:mdt00_002.0 Request processed in 799us (1378us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1790710859.753071:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790710859.753353:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51d03edc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5847:1877696177049472:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1790710859.753405:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b2815715ed lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.753418:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b2815715ed lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.753426:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b2815715ed lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.753432:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c8046e00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1790710859.753438:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b2815715ed lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.753446:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b2815715ed lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.753480:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c51c2c2e200) 00010000:00010000:0.0:1790710859.753483:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790710859.753488:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b2815715ed lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.753495:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b2815715ed lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.753534:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b200/0xcbad34b281571530 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.753540:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b200/0xcbad34b281571530 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.753546:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b200/0xcbad34b281571530 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.753551:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c243b200 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1790710859.753553:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b200/0xcbad34b281571530 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.753560:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b200/0xcbad34b281571530 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.753568:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c51e4efb800) 00010000:00010000:0.0:1790710859.753625:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790710859.753635:0:5847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645000/0xcbad34b281571537 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570005a5 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.753647:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645000/0xcbad34b281571537 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570005a5 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.753664:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645000/0xcbad34b281571537 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570005a5 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.753704:0:5847:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645000/0xcbad34b281571537 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570005a5 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710859.753718:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51d03edf80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1877696177049600:192.168.206.46@tcp:105: 00000100:00100000:0.0:1790710859.753955:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51e4eac3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790710859.759012:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710859.759207:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51d03edf80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1877696177049600:192.168.206.46@tcp:105: 00010000:00010000:0.0:1790710859.759248:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b200/0xcbad34b281571530 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.759260:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b200/0xcbad34b281571530 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.759299:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b600/0xcbad34b2815715f4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.759316:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b600/0xcbad34b2815715f4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.759328:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b600/0xcbad34b2815715f4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.759340:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b600/0xcbad34b2815715f4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.759347:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b600/0xcbad34b2815715f4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.759370:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b600/0xcbad34b2815715f4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.759377:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c243b600 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1790710859.759381:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b600/0xcbad34b2815715f4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.759390:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b600/0xcbad34b2815715f4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.759405:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c51e4efb800) 00010000:00010000:0.0:1790710859.759408:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790710859.759413:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b600/0xcbad34b2815715f4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.759419:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b600/0xcbad34b2815715f4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.759429:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b2815715e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.759435:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b2815715e6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.759441:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b2815715e6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.759446:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c8047a00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1790710859.759449:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b2815715e6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.759464:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b2815715e6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.759473:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c51e4efb800) 00010000:00010000:0.0:1790710859.759475:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790710859.759479:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b2815715e6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710859.759484:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b2815715e6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790710859.759939:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790710859.759946:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790710859.760513:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1790710859.760523:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790710859.761271:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158165248 00000100:00100000:2.0:1790710859.761287:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158165248 00000100:00100000:2.0:1790710859.761369:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 31 00000100:00100000:2.0:1790710859.761380:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4865500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+19:10530:x1877696158165248:12345-192.168.206.46@tcp:49:lfs.0 00000100:00100000:0.0:1790710859.761795:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9ca2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+19:10531:x1877696158164992:12345-192.168.206.46@tcp:57:lhsmtool_posix.0 Request processed in 21907us (22076us total) trans 4294967407 rc 0/0 00000100:00100000:0.0:1790710859.761805:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 127 00000020:00080000:0.0:1790710859.761811:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1790710859.762097:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4865500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+18:10530:x1877696158165248:12345-192.168.206.46@tcp:49:lfs.0 Request processed in 717us (3097us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710859.762105:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 31 00000100:00100000:2.0:1790710859.765413:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710859.765571:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158165504 00000100:00100000:3.0:1790710859.765585:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158165504 00000100:00100000:3.0:1790710859.765654:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 128 00000100:00100000:3.0:1790710859.765666:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f457c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+18:10530:x1877696158165504:12345-192.168.206.46@tcp:58:lfs.0 00000040:00080000:3.0:1790710859.766095:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1790710859.766226:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f457c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+18:10530:x1877696158165504:12345-192.168.206.46@tcp:58:lfs.0 Request processed in 560us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710859.766235:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 128 00000100:00100000:1.0:1790710859.778900:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710859.779496:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158165760 00000100:00100000:3.0:1790710859.779511:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158165760 00000100:00100000:3.0:1790710859.779587:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 32 00000100:00100000:3.0:1790710859.779598:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d6263850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+18:10531:x1877696158165760:12345-192.168.206.46@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1790710859.787986:0:5848:0:(mdd_object.c:4180:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1790710859.788443:0:5848:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967408 00010000:00010000:2.0:1790710859.788524:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046200/0xcbad34b2815715fb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710859.788546:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046200/0xcbad34b2815715fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710859.788560:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046200/0xcbad34b2815715fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710859.788571:0:5848:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046200/0xcbad34b2815715fb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710859.788591:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046200/0xcbad34b2815715fb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710859.788598:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046200/0xcbad34b2815715fb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710859.788632:0:5848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790710859.788861:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790710859.788870:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046200/0xcbad34b2815715fb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710859.788877:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c8046200 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:1.0:1790710859.788882:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046200/0xcbad34b2815715fb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710859.788892:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046200/0xcbad34b2815715fb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710859.788906:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c51cca25500) 00010000:00010000:1.0:1790710859.788919:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1790710859.788925:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046200/0xcbad34b2815715fb lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710859.788931:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046200/0xcbad34b2815715fb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710859.788954:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790710859.788955:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790710859.788957:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790710859.789063:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d6263850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+20:10531:x1877696158165760:12345-192.168.206.46@tcp:35:lhsmtool_posix.0 Request processed in 9461us (10170us total) trans 4294967409 rc 0/0 00000100:00100000:2.0:1790710859.789076:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 32 00000020:00080000:2.0:1790710859.789083:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1790710859.795676:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710859.795905:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158165888 00000100:00100000:3.0:1790710859.795917:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158165888 00000100:00100000:3.0:1790710859.796043:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 129 00000100:00100000:3.0:1790710859.796054:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4864700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+20:10533:x1877696158165888:12345-192.168.206.46@tcp:101:lfs.0 00010000:00010000:3.0:1790710859.796084:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790710859.796107:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b281571602 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b0570005dd expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.796223:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281571609 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.796240:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281571609 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.796252:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281571609 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.796267:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645800/0xcbad34b281571610 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.796275:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645800/0xcbad34b281571610 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.796281:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645800/0xcbad34b281571610 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710859.796923:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481a00/0xcbad34b281571617 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710859.796939:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b281571522 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700059e expref: 21 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710859.796948:0:5846:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481a00/0xcbad34b281571617 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710859.796991:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b281571522 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.46@tcp remote: 0x566877b05700059e expref: 21 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710859.797007:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b281571522 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.46@tcp remote: 0x566877b05700059e expref: 21 pid: 5847 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710859.797022:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4865f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1877696177049728:192.168.206.46@tcp:104: 00000100:00100000:1.0:1790710859.797168:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f9f1cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1790710859.801167:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710859.801268:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4865f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1877696177049728:192.168.206.46@tcp:104: 00010000:00010000:1.0:1790710859.801305:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481a00/0xcbad34b281571617 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710859.802024:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158166144 00000100:00100000:2.0:1790710859.802038:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158166144 00000100:00100000:2.0:1790710859.802114:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 33 00000100:00100000:2.0:1790710859.802124:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9767800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+22:5593:x1877696158166144:12345-192.168.206.46@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1790710859.802456:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9767800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+23:5593:x1877696158166144:12345-192.168.206.46@tcp:35:ldlm_bl.0 Request processed in 332us (1334us total) trans 4294967410 rc 0/0 00000100:00100000:2.0:1790710859.802465:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 33 00000100:00100000:2.0:1790710859.805465:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710859.807200:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158166272 00000100:00100000:0.0:1790710859.807218:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158166272 00010000:00010000:0.0:1790710859.807279:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b281571522 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.46@tcp remote: 0x566877b05700059e expref: 23 pid: 5847 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710859.807425:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 58 00000100:00100000:3.0:1790710859.807440:0:8449:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f457e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+23:2359:x1877696158166272:12345-192.168.206.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790710859.807478:0:8449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790710859.807487:0:8449:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b281571522 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.46@tcp remote: 0x566877b05700059e expref: 23 pid: 5847 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.807502:0:8449:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b281571522 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.46@tcp remote: 0x566877b05700059e expref: 23 pid: 5847 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.807528:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b281571522 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.46@tcp remote: 0x566877b05700059e expref: 23 pid: 5847 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.807551:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c51e4efb800) 00010000:00010000:3.0:1790710859.807557:0:8449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481a00/0xcbad34b281571617 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.807568:0:8449:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481a00/0xcbad34b281571617 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.807591:0:8449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481a00/0xcbad34b281571617 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710859.807627:0:8449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790710859.807701:0:8449:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f457e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+22:2359:x1877696158166272:12345-192.168.206.46@tcp:103:ldlm_bl.0 Request processed in 266us (2250us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710859.807709:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 58 00010000:00010000:1.0:1790710859.807942:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481a00/0xcbad34b281571617 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710859.807953:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481a00/0xcbad34b281571617 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790710859.808005:0:5846:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1790710859.808010:0:5846:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790710859.808251:0:5846:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481a00/0xcbad34b281571617 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710859.808269:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481a00/0xcbad34b281571617 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710859.808280:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281571609 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710859.808288:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281571609 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710859.808296:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281571609 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710859.808303:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c1645200 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1790710859.808307:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281571609 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710859.808315:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281571609 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710859.810029:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c51c2c2ee00) 00010000:00010000:1.0:1790710859.810237:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790710859.810247:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281571609 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710859.810258:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281571609 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710859.810278:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645800/0xcbad34b281571610 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710859.810285:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645800/0xcbad34b281571610 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710859.810292:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645800/0xcbad34b281571610 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710859.810298:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c1645800 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1790710859.810302:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645800/0xcbad34b281571610 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710859.810310:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645800/0xcbad34b281571610 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710859.810319:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c51c2c2e100) 00010000:00010000:1.0:1790710859.810322:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790710859.810324:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645800/0xcbad34b281571610 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710859.810330:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645800/0xcbad34b281571610 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710859.810386:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b281571602 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570005dd expref: 22 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710859.810414:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481a00/0xcbad34b281571617 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570005dd expref: 21 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710859.810421:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c51e4efb800) 00010000:00010000:1.0:1790710859.810423:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790710859.810426:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c6481a00, rc 0) 00000100:00100000:1.0:1790710859.810504:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4864700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+21:10533:x1877696158165888:12345-192.168.206.46@tcp:101:lfs.0 Request processed in 14451us (14842us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710859.810513:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 129 00010000:00010000:3.0:1790710860.298577:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790710860.552366:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51d03eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1877696177050112:0@lo:400:kworker.0 00000100:00100000:0.0:1790710860.552453:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710860.552515:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51d03edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d27fc27-b651-404a-bd8c-b798806fb18a:3312:1877696177049856:0@lo:400:kworker.0 00000100:00100000:0.0:1790710860.552523:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790710860.552531:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51d03eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877696177049984:0@lo:400:kworker.0 00000100:00100000:2.0:1790710860.552571:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710860.552602:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51d03ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1877696177050240:0@lo:400:kworker.0 00000100:00100000:0.0:1790710860.552632:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710860.552670:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177050112 00000100:00100000:0.0:1790710860.552679:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177050112 00000100:00100000:0.0:1790710860.552739:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177049984 00000100:00100000:0.0:1790710860.552773:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177049984 00000100:00100000:0.0:1790710860.552806:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1790710860.552815:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d03eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1877696177050112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790710860.552877:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d03eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1877696177050112:12345-0@lo:400:kworker.0 Request processed in 62us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710860.552884:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1790710860.552903:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1790710860.552909:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d03ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1877696177049984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790710860.552937:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d03ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1877696177049984:12345-0@lo:400:kworker.0 Request processed in 29us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710860.552956:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1790710860.552976:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177049856 00000100:00100000:0.0:1790710860.552980:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177049856 00000100:00100000:0.0:1790710860.553006:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1790710860.553012:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ee78a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+19:3312:x1877696177049856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790710860.553042:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ee78a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+19:3312:x1877696177049856:12345-0@lo:400:kworker.0 Request processed in 31us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710860.553048:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00080000:0.0:1790710860.553075:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790710860.553120:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51d03eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877696177049984:0@lo:400:kworker.0 00000100:00100000:0.0:1790710860.553157:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51d03eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1877696177050112:0@lo:400:kworker.0 00000100:00100000:2.0:1790710860.556983:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51d03edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d27fc27-b651-404a-bd8c-b798806fb18a:3312:1877696177049856:0@lo:400:kworker.0 00000100:00100000:3.0:1790710860.557912:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710860.558046:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177050240 00000100:00100000:1.0:1790710860.558056:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177050240 00000100:00100000:1.0:1790710860.558156:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1790710860.558166:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9766300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1877696177050240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790710860.558252:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9766300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1877696177050240:12345-0@lo:400:kworker.0 Request processed in 87us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710860.558260:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:2.0:1790710860.559906:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790710860.566423:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51d03ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1877696177050240:0@lo:400:kworker.0 00000040:00080000:0.0:1790710860.576650:0:12096:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790710860.576662:0:12096:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790710860.576708:0:12096:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1790710860.576714:0:12096:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1790710860.807458:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790710860.807483:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790710860.807545:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1790710860.807553:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790710860.807879:0:11676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9766a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11676:1877696177050368:192.168.206.46@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790710860.808078:0:11676:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c8dc7900 going to sleep for 11 seconds 00000100:00100000:3.0:1790710860.810793:0:11676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9766a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11676:1877696177050368:192.168.206.46@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790710860.817706:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710860.818657:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158166400 00000100:00100000:0.0:1790710860.818696:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158166400 00000100:00100000:0.0:1790710860.818786:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 130 00000100:00100000:0.0:1790710860.818797:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f457ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+21:10545:x1877696158166400:12345-192.168.206.46@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1790710860.818861:0:5846:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1790710860.819018:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f457ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+21:10545:x1877696158166400:12345-192.168.206.46@tcp:53:lhsmtool_posix.0 Request processed in 221us (1326us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710860.819027:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 130 00000100:00100000:2.0:1790710860.827831:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710860.829698:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158166656 00000100:00100000:1.0:1790710860.829718:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158166656 00000100:00100000:1.0:1790710860.829837:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 131 00000100:00100000:1.0:1790710860.829849:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f457fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+21:10545:x1877696158166656:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790710860.829874:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790710860.829899:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481400/0xcbad34b28157161e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b0570005e4 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710860.830060:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b281571625 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710860.830077:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b281571625 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710860.830094:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b281571625 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790710860.830107:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1790710860.830305:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481400/0xcbad34b28157161e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570005e4 expref: 24 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710860.830327:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b281571625 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570005e4 expref: 23 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710860.830337:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c51e4efb800) 00010000:00010000:1.0:1790710860.830340:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790710860.830344:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c6481c00, rc 0) 00000100:00100000:1.0:1790710860.830439:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f457fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+23:10545:x1877696158166656:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 Request processed in 592us (2621us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1790710860.830448:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 131 00000100:00100000:2.0:1790710860.844414:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710860.844580:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710860.847672:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158167040 00000100:00100000:3.0:1790710860.847697:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158167040 00000100:00100000:3.0:1790710860.847821:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 9 00000100:00100000:3.0:1790710860.847833:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d032df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+23:2357:x1877696158167040:12345-192.168.206.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790710860.847855:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790710860.847887:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b281571625 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570005e4 expref: 23 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710860.847913:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c51e4efb800) 00010000:00010000:3.0:1790710860.847919:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790710860.848006:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d032df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+22:2357:x1877696158167040:12345-192.168.206.46@tcp:103:ldlm_bl.0 Request processed in 174us (3425us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710860.848014:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 9 00000100:00100000:0.0:1790710860.849735:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158166912 00000100:00100000:0.0:1790710860.849753:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158166912 00000100:00100000:0.0:1790710860.849946:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 132 00000100:00100000:0.0:1790710860.849958:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f457ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+22:10545:x1877696158166912:12345-192.168.206.46@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1790710860.850065:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b281571633 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710860.850087:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b281571633 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710860.850099:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b281571633 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710860.850368:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b281571633 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710860.850377:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b281571633 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710860.850384:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b281571633 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710860.850391:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c243b800 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1790710860.850414:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b281571633 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710860.850422:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b281571633 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710860.850436:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c51e4efb800) 00010000:00010000:0.0:1790710860.850439:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790710860.850444:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b281571633 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710860.850450:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b281571633 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790710860.850739:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790710860.850745:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790710860.851611:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1790710860.851622:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790710860.853377:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f457ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+23:10545:x1877696158166912:12345-192.168.206.46@tcp:57:lhsmtool_posix.0 Request processed in 3407us (8961us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1790710860.853395:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 132 00000100:00100000:2.0:1790710860.857986:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710860.858187:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158167296 00000100:00100000:0.0:1790710860.858202:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158167296 00000100:00100000:0.0:1790710860.858276:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 34 00000100:00100000:0.0:1790710860.858289:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f978df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+23:10545:x1877696158167296:12345-192.168.206.46@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1790710860.858666:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f978df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+24:10545:x1877696158167296:12345-192.168.206.46@tcp:35:lhsmtool_posix.0 Request processed in 378us (691us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1790710860.858675:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 34 00000100:00100000:2.0:1790710861.067407:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51d03eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1877696177050496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790710861.067502:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710861.068042:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177050496 00000100:00100000:1.0:1790710861.068053:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177050496 00000100:00100000:1.0:1790710861.068194:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1790710861.068207:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f978e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1877696177050496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790710861.068255:0:6700:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1790710861.069219:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790710861.070362:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f978e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1877696177050496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2148us (2849us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710861.070378:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1790710861.070472:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51d03eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1877696177050496:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1790710861.319411:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790710861.577937:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790710861.577965:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4865f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1877696177050624:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790710861.578047:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710861.578226:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177050624 00000100:00100000:1.0:1790710861.578236:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177050624 00000100:00100000:1.0:1790710861.578321:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1790710861.578332:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d03eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1877696177050624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790710861.578379:0:6699:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3858759680 avail 3856662528 00000100:00100000:1.0:1790710861.578433:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d03eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1877696177050624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710861.578440:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:0.0:1790710861.578769:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790710861.578841:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4865f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1877696177050624:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790710861.789776:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710861.789817:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710861.789856:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710861.789878:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710861.789909:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710861.789943:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158167936 00000100:00100000:1.0:1790710861.789955:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158167936 00000100:00100000:1.0:1790710861.790022:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158167552 00000100:00100000:3.0:1790710861.790108:0:12058:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158167680 00000100:00100000:3.0:1790710861.790112:0:12058:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158167680 00000100:00100000:3.0:1790710861.790163:0:12058:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158167808 00000100:00100000:3.0:1790710861.790166:0:12058:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158167808 00000100:00100000:3.0:1790710861.790214:0:12058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 74 00000100:00100000:3.0:1790710861.790224:0:12058:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4865f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+7:2358:x1877696158167680:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:3.0:1790710861.790316:0:12058:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4865f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+7:2358:x1877696158167680:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 92us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710861.790324:0:12058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 74 00000100:00100000:3.0:1790710861.790344:0:12058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 75 00000100:00100000:3.0:1790710861.790351:0:12058:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c652aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:2358:x1877696158167808:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:3.0:1790710861.790378:0:12058:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c652aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:2358:x1877696158167808:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 28us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710861.790384:0:12058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 75 00000100:00100000:3.0:1790710861.790405:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 142 00000100:00100000:3.0:1790710861.790412:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4865500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1b59f23d-9a5c-439d-bd4a-453bf2315b97+5:2358:x1877696158167936:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:3.0:1790710861.790442:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4865500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1b59f23d-9a5c-439d-bd4a-453bf2315b97+5:2358:x1877696158167936:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 30us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710861.790448:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 142 00000100:00100000:1.0:1790710861.790853:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158167552 00000100:00100000:1.0:1790710861.790884:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 143 00000100:00100000:1.0:1790710861.790892:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c6529880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+24:2358:x1877696158167552:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:1.0:1790710861.790939:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c6529880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+24:2358:x1877696158167552:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 48us (1059us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710861.790945:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 143 00000100:00100000:0.0:1790710861.791473:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158167424 00000100:00100000:0.0:1790710861.791479:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158167424 00000100:00100000:0.0:1790710861.791521:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 291 00000100:00100000:0.0:1790710861.791529:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ee789850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b75d7a5-152f-4db9-bf19-5fe279a322e3+13:2358:x1877696158167424:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:0.0:1790710861.791581:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ee789850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b75d7a5-152f-4db9-bf19-5fe279a322e3+13:2358:x1877696158167424:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 53us (1819us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710861.791589:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 291 00000100:00080000:0.0:1790710861.791625:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790710861.791630:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790710861.791633:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1790710862.346289:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790710862.416954:0:12148:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790710862.416968:0:12148:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790710862.417021:0:12148:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1790710862.417027:0:12148:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790710862.540631:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710862.540731:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158168192 00000100:00100000:0.0:1790710862.540746:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158168192 00000100:00100000:0.0:1790710862.540869:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 133 00000100:00100000:0.0:1790710862.540882:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8e8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+24:10566:x1877696158168192:12345-192.168.206.46@tcp:101:lfs.0 00010000:00010000:0.0:1790710862.540912:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790710862.540937:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243bc00/0xcbad34b28157163a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b0570005eb expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710862.541071:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243a600/0xcbad34b281571641 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710862.541101:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243a600/0xcbad34b281571641 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710862.541115:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243a600/0xcbad34b281571641 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790710862.541153:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1790710862.541367:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243bc00/0xcbad34b28157163a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570005eb expref: 27 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710862.541389:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243a600/0xcbad34b281571641 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570005eb expref: 26 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710862.541400:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c51e4efb800) 00010000:00010000:0.0:1790710862.541404:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1790710862.541408:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c243a600, rc 0) 00000100:00100000:0.0:1790710862.541504:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8e8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+26:10566:x1877696158168192:12345-192.168.206.46@tcp:101:lfs.0 Request processed in 625us (885us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1790710862.541514:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 133 00000100:00100000:3.0:1790710862.549714:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710862.550107:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158168320 00000100:00100000:0.0:1790710862.550121:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158168320 00000100:00100000:0.0:1790710862.550220:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 134 00000100:00100000:0.0:1790710862.550232:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9766a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+26:10566:x1877696158168320:12345-192.168.206.46@tcp:54:lfs.0 00010000:00010000:0.0:1790710862.550319:0:8060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b400/0xcbad34b28157164f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710862.550341:0:8060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b400/0xcbad34b28157164f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710862.550357:0:8060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b400/0xcbad34b28157164f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710862.550389:0:8060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b400/0xcbad34b28157164f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710862.550395:0:8060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b400/0xcbad34b28157164f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710862.550423:0:8060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b400/0xcbad34b28157164f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710862.550429:0:8060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c243b400 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1790710862.550433:0:8060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b400/0xcbad34b28157164f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710862.550442:0:8060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b400/0xcbad34b28157164f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710862.550455:0:8060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c51e4efb800) 00010000:00010000:0.0:1790710862.550457:0:8060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790710862.550462:0:8060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b400/0xcbad34b28157164f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710862.550467:0:8060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b400/0xcbad34b28157164f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710862.550564:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9766a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+26:10566:x1877696158168320:12345-192.168.206.46@tcp:54:lfs.0 Request processed in 333us (860us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710862.550572:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 134 00000100:00100000:1.0:1790710862.642157:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710862.642258:0:12058:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158168448 00000100:00100000:0.0:1790710862.642272:0:12058:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158168448 00000100:00100000:0.0:1790710862.642350:0:12058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 46 00000100:00100000:0.0:1790710862.642363:0:12058:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c652a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:2356:x1877696158168448:12345-192.168.206.46@tcp:101:cat.0 00010000:00010000:0.0:1790710862.642387:0:12058:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790710862.642415:0:12058:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e092b749/0xcbad34b281571656 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b0570005f2 expref: -99 pid: 12058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790710862.642465:0:12058:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6abc144a, atime: 0x6abc1449, ctime: 0x6abc144a, blocks: 0xb 00010000:00010000:0.0:1790710862.642491:0:12058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=339s v=(0 0) 00010000:00010000:0.0:1790710862.642496:0:12058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790710862.642508:0:12058:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e092b749/0xcbad34b281571656 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570005f2 expref: 7 pid: 12058 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710862.642532:0:12058:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e092b749/0xcbad34b281571656 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570005f2 expref: 7 pid: 12058 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710862.642548:0:12058:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c243b400, rc 0) 00000100:00100000:0.0:1790710862.642644:0:12058:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c652a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+7:2356:x1877696158168448:12345-192.168.206.46@tcp:101:cat.0 Request processed in 283us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710862.642652:0:12058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 46 00000100:00100000:2.0:1790710862.648613:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710862.649086:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158168576 00000100:00100000:1.0:1790710862.649104:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158168576 00002000:00100000:1.0:1790710862.649226:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff9c51f4d60a80 x1877696158168576/t0(0) o3->0ec73bd1-726e-4dc0-8edd-807d3f973d65@192.168.206.46@tcp:363/0 lens 488/0 e 0 to 0 dl 1790710873 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790710862.649239:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c51f4d60a80 with x1877696158168576 ext(0->4095) 00002000:00010000:1.0:1790710862.649246:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c51f4d60a80 00000100:00100000:1.0:1790710862.649294:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 3 00000100:00100000:1.0:1790710862.649315:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+7:2356:x1877696158168576:12345-192.168.206.46@tcp:3:cat.0 00000100:00100000:1.0:1790710862.649583:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+7:2356:x1877696158168576:12345-192.168.206.46@tcp:3:cat.0 Request processed in 279us (977us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1790710862.649591:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 3 00002000:00100000:1.0:1790710862.649599:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff9c51f4d60a80 x1877696158168576/t0(0) o3->0ec73bd1-726e-4dc0-8edd-807d3f973d65@192.168.206.46@tcp:363/0 lens 488/4536 e 0 to 0 dl 1790710873 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790710862.649608:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c51f4d60a80 with x1877696158168576 ext(0->4095) 00002000:00010000:1.0:1790710862.649612:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c51f4d60a80 00000001:00080000:3.0:1790710862.685758:0:6720:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:3.0:1790710862.685788:0:6720:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00010000:00010000:0.0:1790710863.372394:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710864.391672:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1790710864.726991:0:5867:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:2.0:1790710864.727018:0:5867:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c51e4eac840 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1790710864.727023:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c51d8332c00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c51e4eac600 00000020:00080000:2.0:1790710864.727027:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c51d8332300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c51f9f02400 00000020:00080000:2.0:1790710864.727065:0:5867:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:0.0:1790710864.727261:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1790710864.727761:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:0.0:1790710865.252960:0:7643:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:0.0:1790710865.252985:0:7643:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00010000:00010000:1.0:1790710865.416489:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790710865.674618:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51ff1af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1877696177051008:0@lo:400:kworker.0 00000100:00100000:2.0:1790710865.674707:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710865.674780:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1790710865.674786:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1877696177050880:0@lo:400:kworker.0 00000100:00100000:2.0:1790710865.674806:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710865.674821:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51ff1adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1877696177051392:0@lo:400:kworker.0 00000100:00100000:2.0:1790710865.674843:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710865.674878:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177051392 00000100:00100000:2.0:1790710865.674887:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177051392 00000100:00100000:2.0:1790710865.674951:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1790710865.674961:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff1ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1877696177051392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790710865.675020:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff1ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1877696177051392:12345-0@lo:400:kworker.0 Request processed in 61us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710865.675044:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1790710865.675092:0:3312:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:2.0:1790710865.675099:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:2.0:1790710865.675123:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51ff1adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1877696177051392:0@lo:400:kworker.0 00000100:00100000:3.0:1790710865.675260:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51ff1ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1877696177051136:0@lo:400:kworker.0 00000100:00100000:3.0:1790710865.675302:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710865.675335:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1790710865.675348:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d27fc27-b651-404a-bd8c-b798806fb18a:3309:1877696177050752:0@lo:400:kworker.0 00000100:00100000:3.0:1790710865.675376:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710865.675405:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51ff1ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1877696177051264:0@lo:400:kworker.0 00000100:00100000:3.0:1790710865.675425:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710865.675626:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177051008 00000100:00100000:1.0:1790710865.675632:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177051008 00000100:00100000:1.0:1790710865.675679:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177050880 00000100:00100000:1.0:1790710865.675683:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177050880 00000100:00100000:1.0:1790710865.675695:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177051264 00000100:00100000:1.0:1790710865.675697:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177051264 00000100:00100000:1.0:1790710865.675714:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1790710865.675721:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff1aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1877696177051008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790710865.675773:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff1aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1877696177051008:12345-0@lo:400:kworker.0 Request processed in 52us (1067us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710865.675789:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1790710865.675807:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1790710865.675813:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff1ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1877696177050880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790710865.675843:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff1ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1877696177050880:12345-0@lo:400:kworker.0 Request processed in 31us (1036us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710865.675849:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1790710865.675859:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1790710865.675865:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1877696177051264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790710865.675895:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1877696177051264:12345-0@lo:400:kworker.0 Request processed in 31us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710865.675900:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1790710865.675934:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51ff1ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1877696177051264:0@lo:400:kworker.0 00000100:00100000:1.0:1790710865.675959:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1877696177050880:0@lo:400:kworker.0 00000100:00100000:1.0:1790710865.675969:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51ff1af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1877696177051008:0@lo:400:kworker.0 00000100:00080000:0.0:1790710865.676083:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790710865.676089:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790710865.676104:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177050752 00000100:00100000:0.0:1790710865.676107:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177050752 00000100:00100000:0.0:1790710865.676173:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1790710865.676181:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ee789050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+19:3309:x1877696177050752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790710865.676220:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ee789050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d27fc27-b651-404a-bd8c-b798806fb18a+19:3309:x1877696177050752:12345-0@lo:400:kworker.0 Request processed in 40us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710865.676232:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1790710865.676276:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d27fc27-b651-404a-bd8c-b798806fb18a:3309:1877696177050752:0@lo:400:kworker.0 00000100:00100000:2.0:1790710865.678612:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177051136 00000100:00100000:2.0:1790710865.678633:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177051136 00000100:00100000:2.0:1790710865.678734:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1790710865.678749:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9764000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1877696177051136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790710865.678875:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9764000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1877696177051136:12345-0@lo:400:kworker.0 Request processed in 131us (3582us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710865.678883:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:0.0:1790710865.679051:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790710865.679364:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1790710865.679373:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:1.0:1790710865.679544:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c51fa2cea00, transno 4294967304 00000100:00100000:1.0:1790710865.679562:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51ff1ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1877696177051136:0@lo:400:kworker.0 00000100:00100000:1.0:1790710866.184250:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51d03ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1877696177051520:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790710866.184352:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710866.184694:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177051520 00000100:00100000:0.0:1790710866.184711:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177051520 00000100:00100000:0.0:1790710866.184781:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1790710866.184793:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c652b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877696177051520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790710866.184832:0:6699:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790710866.184917:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c652b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877696177051520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710866.184928:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1790710866.185097:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51d03ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1877696177051520:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1790710866.441281:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790710866.698244:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790710866.698266:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51ff1adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1877696177051648:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790710866.698328:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710866.698390:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177051648 00000100:00100000:2.0:1790710866.698397:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177051648 00000100:00100000:2.0:1790710866.698437:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1790710866.698445:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff1ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877696177051648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790710866.698478:0:6699:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790710866.698522:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff1ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877696177051648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710866.698529:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1790710866.698574:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51ff1adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1877696177051648:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790710866.810903:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710866.815623:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158168704 00000100:00100000:2.0:1790710866.815640:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158168704 00000100:00100000:3.0:1790710866.815897:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 135 00000100:00100000:3.0:1790710866.815909:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+13:10210:x1877696158168704:12345-192.168.206.46@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1790710866.816496:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+13:10210:x1877696158168704:12345-192.168.206.46@tcp:60:lhsmtool_posix.0 Request processed in 587us (5601us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710866.816506:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 135 00000100:00080000:0.0:1790710866.816639:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790710866.823961:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710866.824369:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158168960 00000100:00100000:2.0:1790710866.824379:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158168960 00000100:00100000:2.0:1790710866.824486:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 35 00000100:00100000:2.0:1790710866.824496:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9764700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+13:10210:x1877696158168960:12345-192.168.206.46@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1790710866.824819:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9764700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+14:10210:x1877696158168960:12345-192.168.206.46@tcp:35:lhsmtool_posix.0 Request processed in 324us (865us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1790710866.824827:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 35 00000100:00100000:2.0:1790710866.911666:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710866.911712:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710866.911741:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710866.911802:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710866.911811:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158169344 00000100:00100000:3.0:1790710866.911829:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158169344 00000100:00100000:2.0:1790710866.911853:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158169472 00000100:00100000:2.0:1790710866.911864:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158169472 00000100:00100000:3.0:1790710866.911922:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158169216 00000100:00100000:3.0:1790710866.911928:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158169216 00000100:00100000:2.0:1790710866.911935:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 147 00000100:00100000:2.0:1790710866.911952:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff1ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1b59f23d-9a5c-439d-bd4a-453bf2315b97+5:2359:x1877696158169472:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:3.0:1790710866.911973:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 78 00000100:00100000:3.0:1790710866.911986:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff1adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:2359:x1877696158169344:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:2.0:1790710866.912033:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff1ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1b59f23d-9a5c-439d-bd4a-453bf2315b97+5:2359:x1877696158169472:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 85us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710866.912041:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 147 00000100:00100000:2.0:1790710866.912091:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 79 00000100:00100000:2.0:1790710866.912100:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff1ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+5:2359:x1877696158169216:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:2.0:1790710866.912180:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff1ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+5:2359:x1877696158169216:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 81us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710866.912190:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 79 00000100:00080000:2.0:1790710866.912213:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790710866.912217:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790710866.912220:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790710866.912231:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff1adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:2359:x1877696158169344:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 246us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710866.912246:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 78 00000100:00100000:1.0:1790710866.912701:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158169088 00000100:00100000:1.0:1790710866.912708:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158169088 00000100:00100000:1.0:1790710866.912749:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 293 00000100:00100000:1.0:1790710866.912756:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ee78b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b75d7a5-152f-4db9-bf19-5fe279a322e3+13:2359:x1877696158169088:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:1.0:1790710866.912806:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ee78b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b75d7a5-152f-4db9-bf19-5fe279a322e3+13:2359:x1877696158169088:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 50us (1149us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710866.912813:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 293 00000040:00080000:3.0:1790710867.017699:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790710867.017707:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790710867.017976:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:3.0:1790710867.017984:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1790710867.465340:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790710868.488286:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790710868.755446:0:12349:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 15:41:07 (1790710867) 00010000:00010000:0.0:1790710869.511833:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1790710869.842313:0:5867:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000001:00080000:2.0:1790710869.842346:0:5867:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:0.0:1790710869.842398:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1790710869.842410:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1790710870.117770:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710870.117879:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158169728 00000100:00100000:1.0:1790710870.117890:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158169728 00000100:00100000:1.0:1790710870.118084:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 136 00000100:00100000:1.0:1790710870.118095:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff1af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+13:11276:x1877696158169728:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790710870.118118:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790710870.118172:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481400/0xcbad34b28157165d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b0570005f9 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710870.118237:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b281571664 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710870.118252:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b281571664 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710870.118263:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b281571664 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710870.118277:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481200/0xcbad34b28157166b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710870.118284:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481200/0xcbad34b28157166b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710870.118303:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481200/0xcbad34b28157166b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710870.118576:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571672 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710870.118586:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571672 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710870.118593:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571672 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790710870.118602:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1790710870.118753:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b281571664 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710870.118761:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b281571664 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710870.118768:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b281571664 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710870.118774:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c6481c00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1790710870.118778:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b281571664 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710870.118786:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b281571664 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710870.118797:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c51c2c2e500) 00010000:00010000:1.0:1790710870.118801:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790710870.118810:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b281571664 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710870.118817:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b281571664 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710870.118828:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481200/0xcbad34b28157166b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710870.118834:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481200/0xcbad34b28157166b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710870.118840:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481200/0xcbad34b28157166b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710870.118845:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c6481200 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1790710870.118848:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481200/0xcbad34b28157166b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710870.118854:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481200/0xcbad34b28157166b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710870.118861:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9c51d8e33500) 00010000:00010000:1.0:1790710870.118863:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790710870.118866:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481200/0xcbad34b28157166b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710870.118872:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481200/0xcbad34b28157166b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1790710870.119007:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1790710870.119816:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481400/0xcbad34b28157165d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570005f9 expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710870.119844:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571672 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570005f9 expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710870.119851:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c51cca25300) 00010000:00010000:1.0:1790710870.119854:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790710870.119856:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c6480c00, rc 0) 00000100:00100000:1.0:1790710870.119920:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff1af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+15:11276:x1877696158169728:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 Request processed in 1827us (2158us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1790710870.119927:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 136 00000100:00100000:2.0:1790710870.126636:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710870.126735:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710870.126977:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158169984 00000100:00100000:1.0:1790710870.126998:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158169984 00000100:00100000:1.0:1790710870.127063:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 10 00000100:00100000:1.0:1790710870.127073:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8e5e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+15:2356:x1877696158169984:12345-192.168.206.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790710870.127089:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790710870.127111:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571672 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570005f9 expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710870.127174:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c51cca25300) 00010000:00010000:1.0:1790710870.127180:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790710870.127233:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8e5e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+14:2356:x1877696158169984:12345-192.168.206.46@tcp:103:ldlm_bl.0 Request processed in 161us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710870.127241:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 10 00000100:00100000:0.0:1790710870.135105:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158169856 00000100:00100000:0.0:1790710870.135119:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158169856 00000100:00100000:0.0:1790710870.137220:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 137 00000100:00100000:0.0:1790710870.137240:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff1ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+14:11276:x1877696158169856:12345-192.168.206.46@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1790710870.137367:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff1ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+14:11276:x1877696158169856:12345-192.168.206.46@tcp:59:lhsmtool_posix.0 Request processed in 134us (10737us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710870.137376:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 137 00010000:00010000:3.0:1790710870.540883:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790710870.793518:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9764380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d27fc27-b651-404a-bd8c-b798806fb18a:3310:1877696177051776:0@lo:400:kworker.0 00000100:00100000:3.0:1790710870.793719:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9766d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1877696177051904:0@lo:400:kworker.0 00000100:00100000:0.0:1790710870.793895:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9765880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1877696177052160:0@lo:400:kworker.0 00000100:00100000:1.0:1790710870.795737:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710870.800281:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710870.800374:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9575500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1877696177052288:0@lo:400:kworker.0 00000100:00100000:1.0:1790710870.800505:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710870.800565:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1877696177052032:0@lo:400:kworker.0 00000100:00100000:1.0:1790710870.800674:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710870.800717:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177051776 00000100:00100000:1.0:1790710870.800726:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177051776 00000100:00100000:0.0:1790710870.800910:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177052160 00000100:00100000:0.0:1790710870.800914:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177052160 00000100:00100000:0.0:1790710870.800967:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1790710870.800978:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d03ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1877696177052160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790710870.801042:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d03ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1877696177052160:12345-0@lo:400:kworker.0 Request processed in 67us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710870.801050:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:0.0:1790710870.801080:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790710870.801112:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9765880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1877696177052160:0@lo:400:kworker.0 00000100:00100000:1.0:1790710870.801156:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1790710870.801165:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ee789c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+19:3310:x1877696177051776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790710870.801204:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ee789c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+19:3310:x1877696177051776:12345-0@lo:400:kworker.0 Request processed in 40us (5471us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710870.801210:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1790710870.801235:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177052288 00000100:00100000:2.0:1790710870.801238:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177052032 00000100:00100000:1.0:1790710870.801239:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177052288 00000100:00100000:2.0:1790710870.801241:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177052032 00000100:00100000:2.0:1790710870.801272:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1790710870.801279:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4866300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1877696177052032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790710870.801308:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710870.801315:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4866300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1877696177052032:12345-0@lo:400:kworker.0 Request processed in 37us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710870.801321:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1790710870.801372:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c652f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177052416:0@lo:400:kworker.0 00000100:00080000:0.0:1790710870.801377:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790710870.801398:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710870.801500:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177052416 00000100:00100000:3.0:1790710870.801504:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177052416 00000100:00100000:3.0:1790710870.801536:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1790710870.801542:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c652d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1877696177052416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790710870.801576:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c652d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1877696177052416:12345-0@lo:400:kworker.0 Request processed in 34us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710870.801668:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1790710870.801697:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c652f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177052416:0@lo:400:kworker.0 00000100:00100000:2.0:1790710870.804319:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177051904 00000100:00100000:2.0:1790710870.804335:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177051904 00000100:00100000:2.0:1790710870.804380:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1790710870.804391:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1877696177052288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790710870.804477:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1877696177052288:12345-0@lo:400:kworker.0 Request processed in 88us (3971us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710870.804484:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1790710870.804503:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1790710870.804509:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c652ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1877696177051904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790710870.804549:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c652ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1877696177051904:12345-0@lo:400:kworker.0 Request processed in 40us (3241us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710870.804555:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1790710870.806666:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9766d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1877696177051904:0@lo:400:kworker.0 00000100:00100000:1.0:1790710870.807034:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1877696177052032:0@lo:400:kworker.0 00000100:00100000:1.0:1790710870.807208:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9575500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1877696177052288:0@lo:400:kworker.0 00000100:00100000:1.0:1790710870.807219:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9764380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d27fc27-b651-404a-bd8c-b798806fb18a:3310:1877696177051776:0@lo:400:kworker.0 00000100:00080000:0.0:1790710870.807317:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:2.0:1790710871.111456:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790710871.111465:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790710871.111514:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:2.0:1790710871.111519:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790710871.310575:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f3e75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1877696177052544:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790710871.310637:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710871.311001:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177052544 00000100:00100000:0.0:1790710871.311009:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177052544 00000100:00100000:0.0:1790710871.311063:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1790710871.311073:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9575500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877696177052544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790710871.311107:0:6699:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790710871.312293:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9575500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877696177052544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1216us (1650us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710871.312302:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1790710871.312428:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f3e75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1877696177052544:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1790710871.560602:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790710871.815320:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790710871.816376:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f3e74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1877696177052672:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790710871.816445:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710871.819536:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177052672 00000100:00100000:2.0:1790710871.819550:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177052672 00000100:00100000:2.0:1790710871.819605:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1790710871.819615:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f457e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877696177052672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790710871.819647:0:6700:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790710871.819717:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f457e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877696177052672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (3272us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710871.819724:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1790710871.819823:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f3e74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1877696177052672:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790710871.931554:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710871.931728:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158170112 00000100:00100000:3.0:1790710871.931740:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158170112 00000100:00100000:3.0:1790710871.931796:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 138 00000100:00100000:3.0:1790710871.931806:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d032df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+14:11318:x1877696158170112:12345-192.168.206.46@tcp:101:lfs.0 00010000:00010000:3.0:1790710871.931829:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790710871.931849:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1644a00/0xcbad34b281571680 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b057000600 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710871.931918:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645e00/0xcbad34b281571687 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710871.931932:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645e00/0xcbad34b281571687 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710871.931944:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645e00/0xcbad34b281571687 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710871.931969:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b28157168e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710871.931989:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b28157168e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710871.931995:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b28157168e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710871.932324:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645e00/0xcbad34b281571687 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710871.932333:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645e00/0xcbad34b281571687 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710871.932340:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645e00/0xcbad34b281571687 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710871.932346:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c1645e00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1790710871.932350:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645e00/0xcbad34b281571687 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710871.932357:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645e00/0xcbad34b281571687 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710871.932369:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c51d8e33600) 00010000:00010000:3.0:1790710871.932372:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790710871.932377:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645e00/0xcbad34b281571687 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710871.932383:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645e00/0xcbad34b281571687 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710871.932398:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b28157168e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710871.932403:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b28157168e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710871.932409:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b28157168e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710871.932414:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c1645c00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1790710871.932417:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b28157168e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710871.932422:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b28157168e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710871.932429:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9c51c2c2ec00) 00010000:00010000:3.0:1790710871.932432:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790710871.932435:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b28157168e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710871.932440:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b28157168e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710871.932471:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1644a00/0xcbad34b281571680 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000600 expref: 15 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710871.932480:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c51d8e33600) 00010000:00010000:3.0:1790710871.932483:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790710871.932493:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1644a00/0xcbad34b281571680 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000600 expref: 15 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710871.932505:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c1644a00, rc 0) 00000100:00100000:3.0:1790710871.932566:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d032df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+14:11318:x1877696158170112:12345-192.168.206.46@tcp:101:lfs.0 Request processed in 761us (1021us total) trans 0 rc 301/301 00000100:00100000:3.0:1790710871.939552:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 138 00000100:00100000:3.0:1790710871.940507:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710871.940586:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158170368 00000100:00100000:1.0:1790710871.940603:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158170368 00000100:00100000:1.0:1790710871.940655:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 139 00000100:00100000:1.0:1790710871.940664:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c652f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+14:11318:x1877696158170368:12345-192.168.206.46@tcp:36:lfs.0 00010000:00010000:1.0:1790710871.940713:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790710871.940747:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480400/0xcbad34b28157100c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000440 expref: 14 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710871.940766:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c51d8e33600) 00010000:00010000:1.0:1790710871.940776:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790710871.941162:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481400/0xcbad34b281571695 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710871.941176:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481400/0xcbad34b281571695 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710871.941185:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481400/0xcbad34b281571695 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710871.941197:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b28157169c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710871.941204:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b28157169c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710871.941210:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b28157169c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790710871.942194:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1790710871.942206:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481400/0xcbad34b281571695 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710871.942215:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481400/0xcbad34b281571695 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710871.942228:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481400/0xcbad34b281571695 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710871.942234:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c6481400 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1790710871.942238:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481400/0xcbad34b281571695 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710871.942246:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481400/0xcbad34b281571695 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710871.942258:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c51d8e33500) 00010000:00010000:1.0:1790710871.942261:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790710871.942265:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481400/0xcbad34b281571695 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710871.942271:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481400/0xcbad34b281571695 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790710871.942289:0:5845:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000008073ad6f reply state 00000000f7086845 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b28157169c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710871.942296:0:5845:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790710871.942396:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c652f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+15:11318:x1877696158170368:12345-192.168.206.46@tcp:36:lfs.0 Request processed in 1730us (1889us total) trans 4294967417 rc 0/0 00000100:00100000:1.0:1790710871.942404:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 139 00010000:00010000:2.0:1790710871.951204:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b28157169c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710871.951222:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b28157169c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710871.951231:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b28157169c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710871.951237:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c6480c00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1790710871.951242:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b28157169c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710871.951250:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b28157169c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710871.951264:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9c51d8e33c00) 00010000:00010000:2.0:1790710871.951268:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790710871.951278:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b28157169c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710871.951285:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b28157169c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710872.041713:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710872.041815:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710872.041845:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710872.041873:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710872.041900:0:12058:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158170752 00000100:00100000:0.0:1790710872.041909:0:12058:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158170752 00000100:00100000:0.0:1790710872.041958:0:12058:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158170624 00000100:00100000:0.0:1790710872.041966:0:12058:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158170624 00000100:00100000:0.0:1790710872.041994:0:12058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 82 00000100:00100000:0.0:1790710872.042003:0:12058:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d03edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:2357:x1877696158170752:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:0.0:1790710872.042072:0:12058:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d03edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:2357:x1877696158170752:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 70us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710872.042080:0:12058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 82 00000100:00100000:0.0:1790710872.042097:0:12058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 83 00000100:00100000:0.0:1790710872.042104:0:12058:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d03eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+5:2357:x1877696158170624:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:1.0:1790710872.042114:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158170496 00000100:00100000:1.0:1790710872.042118:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158170496 00000100:00100000:0.0:1790710872.042161:0:12058:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d03eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+5:2357:x1877696158170624:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 57us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710872.042168:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 295 00000100:00100000:0.0:1790710872.042168:0:12058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 83 00000100:00100000:1.0:1790710872.042175:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8ff8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b75d7a5-152f-4db9-bf19-5fe279a322e3+13:2357:x1877696158170496:12345-192.168.206.46@tcp:400:kworker.0 00000100:00080000:0.0:1790710872.042184:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790710872.042187:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790710872.042208:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8ff8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b75d7a5-152f-4db9-bf19-5fe279a322e3+13:2357:x1877696158170496:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 34us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710872.042214:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 295 00000100:00100000:2.0:1790710872.042563:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158170880 00000100:00100000:2.0:1790710872.042568:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158170880 00000100:00100000:2.0:1790710872.042617:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 151 00000100:00100000:2.0:1790710872.042626:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d03ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1b59f23d-9a5c-439d-bd4a-453bf2315b97+5:2357:x1877696158170880:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:2.0:1790710872.042661:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d03ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1b59f23d-9a5c-439d-bd4a-453bf2315b97+5:2357:x1877696158170880:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 37us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710872.042668:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 151 00000100:00080000:1.0:1790710872.044245:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790710872.064014:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710872.064100:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158171008 00000100:00100000:3.0:1790710872.064109:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158171008 00000100:00100000:3.0:1790710872.064198:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 140 00000100:00100000:3.0:1790710872.064208:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d03edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+14:11326:x1877696158171008:12345-192.168.206.46@tcp:101:lctl.0 00010000:00010000:3.0:1790710872.064232:0:8060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790710872.064254:0:8060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1644a00/0xcbad34b2815716a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b057000607 expref: -99 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710872.064325:0:8060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b2815716aa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710872.064338:0:8060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b2815716aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710872.064349:0:8060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b2815716aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790710872.064381:0:8060:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790710872.064385:0:8060:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790710872.064407:0:8060:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b2815716aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710872.064448:0:8060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1644a00/0xcbad34b2815716a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000607 expref: 16 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710872.064466:0:8060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b2815716aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000607 expref: 15 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710872.064475:0:8060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c51c2c2ec00) 00010000:00010000:3.0:1790710872.064477:0:8060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790710872.064481:0:8060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c1645c00, rc 0) 00000100:00100000:3.0:1790710872.064541:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d03edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+15:11326:x1877696158171008:12345-192.168.206.46@tcp:101:lctl.0 Request processed in 334us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710872.064549:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 140 00000100:00080000:1.0:1790710872.064616:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790710872.143469:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710872.143568:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158171136 00000100:00100000:2.0:1790710872.143578:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158171136 00000100:00100000:2.0:1790710872.143636:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 141 00000100:00100000:2.0:1790710872.143646:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+15:11332:x1877696158171136:12345-192.168.206.46@tcp:101:bash.0 00010000:00010000:2.0:1790710872.143667:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790710872.143688:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b2815716b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b05700060e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710872.143861:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b2815716b8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710872.143877:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b2815716b8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710872.143890:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b2815716b8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710872.143923:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b2815716bf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710872.143931:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b2815716bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710872.143937:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b2815716bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710872.144422:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047000/0xcbad34b2815716c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710872.144433:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047000/0xcbad34b2815716c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710872.144441:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047000/0xcbad34b2815716c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790710872.144467:0:5846:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1790710872.144471:0:5846:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790710872.144488:0:5846:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047000/0xcbad34b2815716c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710872.144499:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b2815716b8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710872.144506:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b2815716b8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710872.144512:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b2815716b8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710872.144528:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c8046e00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1790710872.144532:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b2815716b8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710872.144540:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b2815716b8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710872.144552:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c51c2c2ec00) 00010000:00010000:2.0:1790710872.144555:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790710872.144559:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b2815716b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710872.144566:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b2815716b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710872.144581:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b2815716bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710872.144587:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b2815716bf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710872.144593:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b2815716bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710872.144597:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c8046800 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1790710872.144599:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b2815716bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710872.144604:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b2815716bf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710872.144620:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9c51cca25200) 00010000:00010000:2.0:1790710872.144622:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790710872.144625:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b2815716bf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710872.144630:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b2815716bf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710872.144660:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b2815716b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700060e expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710872.144673:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047000/0xcbad34b2815716c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700060e expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710872.144679:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c51cca25000) 00010000:00010000:2.0:1790710872.144681:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1790710872.144683:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c8047000, rc 0) 00000100:00100000:2.0:1790710872.144798:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+16:11332:x1877696158171136:12345-192.168.206.46@tcp:101:bash.0 Request processed in 1153us (1337us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710872.144806:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 141 00000100:00100000:0.0:1790710872.148552:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710872.148647:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158171392 00000100:00100000:1.0:1790710872.148657:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158171392 00000100:00100000:1.0:1790710872.148766:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 142 00000100:00100000:1.0:1790710872.148776:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9764380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+16:11332:x1877696158171392:12345-192.168.206.46@tcp:101:bash.0 00010000:00010000:1.0:1790710872.148795:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790710872.148815:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481400/0xcbad34b2815716cd lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b057000615 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710872.148940:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480400/0xcbad34b2815716d4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710872.148955:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480400/0xcbad34b2815716d4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710872.148967:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480400/0xcbad34b2815716d4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710872.149050:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b2815716db lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710872.149058:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b2815716db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710872.149066:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b2815716db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790710872.149919:0:5845:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:1.0:1790710872.152336:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480200/0xcbad34b2815716e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710872.152360:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480200/0xcbad34b2815716e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710872.152373:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480200/0xcbad34b2815716e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710872.152416:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480400/0xcbad34b2815716d4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710872.152424:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480400/0xcbad34b2815716d4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710872.152431:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480400/0xcbad34b2815716d4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710872.152437:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c6480400 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1790710872.152441:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480400/0xcbad34b2815716d4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710872.152449:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480400/0xcbad34b2815716d4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710872.152461:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c51cca25000) 00010000:00010000:1.0:1790710872.152464:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790710872.152469:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480400/0xcbad34b2815716d4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710872.152492:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480400/0xcbad34b2815716d4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790710872.152510:0:5845:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000c3303d09 reply state 000000006eb8f7f8 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b2815716db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710872.152519:0:5845:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1790710872.152555:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481400/0xcbad34b2815716cd lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000615 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710872.152571:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480200/0xcbad34b2815716e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000615 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710872.152578:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c51d8e33600) 00010000:00010000:1.0:1790710872.152580:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790710872.152582:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c6480200, rc 0) 00000100:00100000:1.0:1790710872.152725:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9764380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+19:11332:x1877696158171392:12345-192.168.206.46@tcp:101:bash.0 Request processed in 3949us (4180us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1790710872.152734:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 142 00000100:00100000:0.0:1790710872.157031:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710872.157100:0:12058:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158171520 00000100:00100000:1.0:1790710872.157110:0:12058:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158171520 00000100:00100000:1.0:1790710872.157190:0:12058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 47 00000100:00100000:1.0:1790710872.157199:0:12058:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9765f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+5:2357:x1877696158171520:12345-192.168.206.46@tcp:101:bash.0 00010000:00010000:1.0:1790710872.157217:0:12058:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790710872.157235:0:12058:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba7388b8/0xcbad34b2815716f0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b05700061c expref: -99 pid: 12058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790710872.157278:0:12058:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790710872.157297:0:12058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=349s v=(0 0) 00010000:00010000:1.0:1790710872.157301:0:12058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790710872.157310:0:12058:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba7388b8/0xcbad34b2815716f0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700061c expref: 6 pid: 12058 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710872.157340:0:12058:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ba7388b8/0xcbad34b2815716f0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700061c expref: 6 pid: 12058 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710872.157352:0:12058:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c6481000, rc 0) 00000100:00100000:1.0:1790710872.157407:0:12058:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9765f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:2357:x1877696158171520:12345-192.168.206.46@tcp:101:bash.0 Request processed in 209us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710872.157415:0:12058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 47 00000100:00100000:0.0:1790710872.160398:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710872.160495:0:6696:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158171648 00000100:00100000:1.0:1790710872.160505:0:6696:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158171648 00000100:00100000:1.0:1790710872.160552:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 48 00000100:00100000:1.0:1790710872.160560:0:6696:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9766d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:11332:x1877696158171648:12345-192.168.206.46@tcp:101:bash.0 00010000:00010000:1.0:1790710872.160577:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790710872.160594:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd24760f/0xcbad34b2815716f7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b057000623 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710872.160623:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba7388b8/0xcbad34b2815716f0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700061c expref: 7 pid: 12058 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710872.160650:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790710872.160654:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790710872.160661:0:6696:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd24760f/0xcbad34b2815716f7 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000623 expref: 7 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710872.160695:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ba7388b8/0xcbad34b2815716f0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.46@tcp remote: 0x566877b05700061c expref: 7 pid: 12058 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710872.160708:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ba7388b8/0xcbad34b2815716f0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.46@tcp remote: 0x566877b05700061c expref: 7 pid: 12058 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710872.160722:0:6696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d5e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6696:1877696177052800:192.168.206.46@tcp:104: 00000100:00100000:1.0:1790710872.160816:0:6696:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f956d9c0 going to sleep for 11 seconds 00010000:00010000:2.0:1790710872.161372:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b2815716db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710872.161384:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b2815716db lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710872.161391:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b2815716db lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710872.161408:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c6480e00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1790710872.161412:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b2815716db lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710872.161419:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b2815716db lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710872.161434:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c51d8e33500) 00010000:00010000:2.0:1790710872.161437:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790710872.161441:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b2815716db lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710872.161447:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b2815716db lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710872.164032:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710872.164186:0:6696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d5e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6696:1877696177052800:192.168.206.46@tcp:104: 00010000:00010000:1.0:1790710872.164217:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cd24760f/0xcbad34b2815716f7 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.46@tcp remote: 0x566877b057000623 expref: 7 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710872.164236:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c6480c00, rc 0) 00000100:00100000:1.0:1790710872.164285:0:6696:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9766d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+7:11332:x1877696158171648:12345-192.168.206.46@tcp:101:bash.0 Request processed in 3725us (3896us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710872.164293:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 48 00000100:00100000:0.0:1790710872.164374:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158171776 00000100:00100000:0.0:1790710872.164381:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158171776 00010000:00010000:0.0:1790710872.164410:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ba7388b8/0xcbad34b2815716f0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.46@tcp remote: 0x566877b05700061c expref: 7 pid: 12058 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710872.164439:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 59 00000100:00100000:0.0:1790710872.164446:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c652fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+7:2358:x1877696158171776:12345-192.168.206.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790710872.164460:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790710872.164479:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ba7388b8/0xcbad34b2815716f0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.46@tcp remote: 0x566877b05700061c expref: 7 pid: 12058 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.164503:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ba7388b8/0xcbad34b2815716f0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.46@tcp remote: 0x566877b05700061c expref: 7 pid: 12058 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.164525:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba7388b8/0xcbad34b2815716f0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.46@tcp remote: 0x566877b05700061c expref: 7 pid: 12058 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.164537:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790710872.164541:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790710872.164549:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cd24760f/0xcbad34b2815716f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.46@tcp remote: 0x566877b057000623 expref: 6 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.164559:0:5829:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd24760f/0xcbad34b2815716f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.46@tcp remote: 0x566877b057000623 expref: 6 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.164589:0:5829:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000cd24760f/0xcbad34b2815716f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.46@tcp remote: 0x566877b057000623 expref: 6 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710872.164603:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9765880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5829:1877696177052928:192.168.206.46@tcp:105: 00000100:00100000:0.0:1790710872.164646:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f4ecf840 going to sleep for 11 seconds 00000100:00100000:0.0:1790710872.168254:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9765880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5829:1877696177052928:192.168.206.46@tcp:105: 00010000:00010000:0.0:1790710872.168279:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790710872.168343:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c652fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:2358:x1877696158171776:12345-192.168.206.46@tcp:103:ldlm_bl.0 Request processed in 3896us (4317us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710872.168353:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 59 00000100:00100000:2.0:1790710872.170952:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710872.171039:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158172032 00000100:00100000:0.0:1790710872.171049:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158172032 00000100:00100000:0.0:1790710872.171110:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 36 00000100:00100000:0.0:1790710872.171118:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f3e74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+18:11332:x1877696158172032:12345-192.168.206.46@tcp:35:bash.0 00000100:00100000:0.0:1790710872.171676:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f3e74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+19:11332:x1877696158172032:12345-192.168.206.46@tcp:35:bash.0 Request processed in 555us (731us total) trans 4294967419 rc 0/0 00000100:00100000:0.0:1790710872.171685:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 36 00000100:00100000:3.0:1790710872.270915:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710872.271300:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158172288 00000100:00100000:2.0:1790710872.271309:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158172288 00000100:00100000:2.0:1790710872.271381:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 143 00000100:00100000:2.0:1790710872.271392:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c652dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+19:11342:x1877696158172288:12345-192.168.206.46@tcp:101:lfs.0 00010000:00010000:2.0:1790710872.271416:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790710872.271435:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b2815716fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b05700062a expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790710872.271631:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1790710872.271737:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b2815716fe lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700062a expref: 21 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710872.271778:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c51c2c2ec00) 00010000:00010000:2.0:1790710872.271781:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790710872.271787:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b2815716fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700062a expref: 21 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710872.271801:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c8046800, rc 0) 00000100:00100000:2.0:1790710872.271899:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c652dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+20:11342:x1877696158172288:12345-192.168.206.46@tcp:101:lfs.0 Request processed in 508us (993us total) trans 4294967420 rc 301/301 00000100:00100000:2.0:1790710872.271906:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 143 00000100:00100000:0.0:1790710872.277863:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710872.277945:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158172544 00000100:00100000:2.0:1790710872.277954:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158172544 00000100:00100000:2.0:1790710872.278020:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 37 00000100:00100000:2.0:1790710872.278031:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9765880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+20:11342:x1877696158172544:12345-192.168.206.46@tcp:35:lfs.0 00000100:00100000:2.0:1790710872.278284:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9765880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+21:11342:x1877696158172544:12345-192.168.206.46@tcp:35:lfs.0 Request processed in 253us (430us total) trans 4294967421 rc 0/0 00000100:00100000:2.0:1790710872.278292:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 37 00000100:00100000:1.0:1790710872.371662:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710872.371758:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158172672 00000100:00100000:3.0:1790710872.371767:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158172672 00000100:00100000:3.0:1790710872.371825:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 144 00000100:00100000:3.0:1790710872.371834:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+21:11348:x1877696158172672:12345-192.168.206.46@tcp:101:lfs.0 00010000:00010000:3.0:1790710872.371860:0:8060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790710872.371880:0:8060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645e00/0xcbad34b28157170c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b057000631 expref: -99 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710872.371941:0:8060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1644a00/0xcbad34b281571713 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710872.371953:0:8060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1644a00/0xcbad34b281571713 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710872.371996:0:8060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1644a00/0xcbad34b281571713 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790710872.372030:0:8060:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1790710872.372034:0:8060:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790710872.372055:0:8060:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1644a00/0xcbad34b281571713 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710872.372081:0:8060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645e00/0xcbad34b28157170c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000631 expref: 23 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710872.372098:0:8060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1644a00/0xcbad34b281571713 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000631 expref: 22 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710872.372106:0:8060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c51cca25000) 00010000:00010000:3.0:1790710872.372109:0:8060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790710872.372112:0:8060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c1644a00, rc 0) 00000100:00100000:3.0:1790710872.372213:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+22:11348:x1877696158172672:12345-192.168.206.46@tcp:101:lfs.0 Request processed in 380us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710872.372220:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 144 00000100:00100000:2.0:1790710872.378952:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710872.379103:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158172928 00000100:00100000:0.0:1790710872.379114:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158172928 00000100:00100000:0.0:1790710872.379206:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 145 00000100:00100000:0.0:1790710872.379216:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f3e74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+22:11348:x1877696158172928:12345-192.168.206.46@tcp:101:lfs.0 00010000:00010000:0.0:1790710872.379234:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790710872.379252:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ba00/0xcbad34b28157171a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b057000638 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.379553:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b281571721 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.379567:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b281571721 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.379577:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b281571721 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790710872.379588:0:5846:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1790710872.379703:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ba00/0xcbad34b28157171a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000638 expref: 25 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.379736:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b281571721 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000638 expref: 24 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.379756:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c51d8e33600) 00010000:00010000:0.0:1790710872.379760:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790710872.379763:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c243b800, rc 0) 00000100:00100000:0.0:1790710872.379827:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f3e74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+24:11348:x1877696158172928:12345-192.168.206.46@tcp:101:lfs.0 Request processed in 613us (884us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1790710872.379834:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 145 00000100:00100000:0.0:1790710872.386826:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710872.388035:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710872.388358:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158173312 00000100:00100000:3.0:1790710872.388368:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158173312 00000100:00100000:3.0:1790710872.388429:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 146 00000100:00100000:3.0:1790710872.388439:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f3e75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+24:11348:x1877696158173312:12345-192.168.206.46@tcp:101:lfs.0 00010000:00010000:3.0:1790710872.388462:0:8060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790710872.388683:0:8060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645e00/0xcbad34b28157172f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b05700063f expref: -99 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710872.388813:0:8060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645800/0xcbad34b281571736 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710872.388827:0:8060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645800/0xcbad34b281571736 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710872.388839:0:8060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645800/0xcbad34b281571736 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790710872.388851:0:8060:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1790710872.388981:0:8060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645e00/0xcbad34b28157172f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700063f expref: 27 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710872.389001:0:8060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645800/0xcbad34b281571736 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700063f expref: 26 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710872.389010:0:8060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c51d8e33600) 00010000:00010000:3.0:1790710872.389013:0:8060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1790710872.389016:0:8060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c1645800, rc 0) 00000100:00100000:3.0:1790710872.389080:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f3e75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+26:11348:x1877696158173312:12345-192.168.206.46@tcp:101:lfs.0 Request processed in 642us (1048us total) trans 4294967423 rc 0/0 00000100:00100000:3.0:1790710872.389087:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 146 00000100:00100000:1.0:1790710872.393851:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158173056 00000100:00100000:1.0:1790710872.393869:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158173056 00000100:00100000:3.0:1790710872.396459:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710872.397191:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 11 00000100:00100000:0.0:1790710872.397203:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51fa2cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+26:2356:x1877696158173056:12345-192.168.206.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790710872.397219:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790710872.397242:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b281571721 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000638 expref: 26 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.397379:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c51d8e33600) 00010000:00010000:0.0:1790710872.397385:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790710872.397595:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51fa2cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+25:2356:x1877696158173056:12345-192.168.206.46@tcp:103:ldlm_bl.0 Request processed in 394us (10776us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710872.397603:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 11 00000100:00100000:1.0:1790710872.397662:0:12058:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158173440 00000100:00100000:1.0:1790710872.397670:0:12058:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158173440 00000100:00100000:1.0:1790710872.397704:0:12058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 49 00000100:00100000:1.0:1790710872.397711:0:12058:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c652ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:2357:x1877696158173440:12345-192.168.206.46@tcp:1:lfs.0 00010000:00010000:1.0:1790710872.397828:0:12058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa52bd29/0xcbad34b281571744 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710872.397846:0:12058:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cd24760f/0xcbad34b2815716f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.46@tcp remote: 0x566877b057000623 expref: 6 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710872.397855:0:12058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790710872.397859:0:12058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790710872.397864:0:12058:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa52bd29/0xcbad34b281571744 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710872.397896:0:12058:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cd24760f/0xcbad34b2815716f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.46@tcp remote: 0x566877b057000623 expref: 6 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710872.397909:0:12058:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cd24760f/0xcbad34b2815716f7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.46@tcp remote: 0x566877b057000623 expref: 6 pid: 6696 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710872.397923:0:12058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d5fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12058:1877696177053056:192.168.206.46@tcp:104: 00000100:00100000:1.0:1790710872.397992:0:12058:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f956d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790710872.402258:0:12058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d5fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12058:1877696177053056:192.168.206.46@tcp:104: 00010000:00010000:1.0:1790710872.402295:0:12058:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000aa52bd29/0xcbad34b281571744 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710872.402709:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710872.402791:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158173568 00000100:00100000:1.0:1790710872.402798:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158173568 00002000:00100000:1.0:1790710872.402843:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9c51f4009500 x1877696158173568/t0(0) o4->0ec73bd1-726e-4dc0-8edd-807d3f973d65@192.168.206.46@tcp:373/0 lens 504/0 e 0 to 0 dl 1790710883 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790710872.402853:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c51f4009500 with x1877696158173568 ext(0->12) 00010000:00010000:1.0:1790710872.402861:0:6701:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000cd24760f/0xcbad34b2815716f7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.46@tcp remote: 0x566877b057000623 expref: 7 pid: 6696 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710872.402874:0:6701:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000cd24760f/0xcbad34b2815716f7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.46@tcp remote: 0x566877b057000623 expref: 7 pid: 6696 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790710872.402882:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9c51f4009500 00000100:00100000:1.0:1790710872.402917:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 2 00000100:00100000:1.0:1790710872.402926:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4009500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+7:2358:x1877696158173568:12345-192.168.206.46@tcp:4:lfs.0 00000100:00100000:1.0:1790710872.403644:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4009500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+9:2358:x1877696158173568:12345-192.168.206.46@tcp:4:lfs.0 Request processed in 716us (934us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1790710872.403652:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 2 00002000:00100000:1.0:1790710872.403660:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9c51f4009500 x1877696158173568/t4294967305(0) o4->0ec73bd1-726e-4dc0-8edd-807d3f973d65@192.168.206.46@tcp:373/0 lens 504/448 e 0 to 0 dl 1790710883 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790710872.403669:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c51f4009500 with x1877696158173568 ext(0->12) 00010000:00010000:1.0:1790710872.403675:0:6701:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000cd24760f/0xcbad34b2815716f7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.46@tcp remote: 0x566877b057000623 expref: 9 pid: 6696 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710872.403699:0:6701:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000cd24760f/0xcbad34b2815716f7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.46@tcp remote: 0x566877b057000623 expref: 9 pid: 6696 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790710872.403707:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9c51f4009500 00000100:00100000:2.0:1790710872.407508:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710872.407638:0:8449:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158173696 00000100:00100000:3.0:1790710872.407648:0:8449:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158173696 00010000:00010000:3.0:1790710872.407685:0:8449:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cd24760f/0xcbad34b2815716f7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.46@tcp remote: 0x566877b057000623 expref: 9 pid: 6696 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710872.407750:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 60 00000100:00100000:3.0:1790710872.407759:0:8449:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4008a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+9:2359:x1877696158173696:12345-192.168.206.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790710872.407775:0:8449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1790710872.407792:0:8449:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1790710872.407794:0:8449:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1790710871 00002000:00010000:3.0:1790710872.407796:0:8449:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1790710872 00002000:00010000:3.0:1790710872.407798:0:8449:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1790710871 00010000:00010000:3.0:1790710872.407804:0:8449:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cd24760f/0xcbad34b2815716f7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.46@tcp remote: 0x566877b057000623 expref: 9 pid: 6696 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710872.407815:0:8449:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cd24760f/0xcbad34b2815716f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.46@tcp remote: 0x566877b057000623 expref: 9 pid: 6696 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710872.407836:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd24760f/0xcbad34b2815716f7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.46@tcp remote: 0x566877b057000623 expref: 9 pid: 6696 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710872.407850:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790710872.407854:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790710872.407859:0:8449:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000aa52bd29/0xcbad34b281571744 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710872.407868:0:8449:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa52bd29/0xcbad34b281571744 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710872.407895:0:8449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790710872.407949:0:8449:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4008a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+8:2359:x1877696158173696:12345-192.168.206.46@tcp:103:ldlm_bl.0 Request processed in 191us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710872.407956:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 60 00010000:00010000:1.0:1790710872.408675:0:12058:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000aa52bd29/0xcbad34b281571744 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710872.408687:0:12058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa52bd29/0xcbad34b281571744 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710872.408710:0:12058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa52bd29/0xcbad34b281571744 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710872.408719:0:12058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aa52bd29/0xcbad34b281571744 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710872.408726:0:12058:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aa52bd29/0xcbad34b281571744 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710872.408732:0:12058:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c6481200 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:1.0:1790710872.408736:0:12058:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa52bd29/0xcbad34b281571744 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710872.408743:0:12058:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa52bd29/0xcbad34b281571744 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710872.408767:0:12058:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aa52bd29/0xcbad34b281571744 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710872.408774:0:12058:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa52bd29/0xcbad34b281571744 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710872.408834:0:12058:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c652ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+7:2357:x1877696158173440:12345-192.168.206.46@tcp:1:lfs.0 Request processed in 11123us (12384us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710872.408842:0:12058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 49 00000100:00100000:2.0:1790710872.412891:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710872.413089:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158173952 00000100:00100000:0.0:1790710872.413099:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158173952 00000100:00100000:0.0:1790710872.413598:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 38 00000100:00100000:0.0:1790710872.413619:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d6261c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+25:11348:x1877696158173952:12345-192.168.206.46@tcp:35:lfs.0 00000004:00010000:0.0:1790710872.413720:0:5849:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645800/0xcbad34b281571736 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700063f expref: 25 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790710872.414355:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:0.0:1790710872.414411:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:0.0:1790710872.417559:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967426 00010000:00010000:0.0:1790710872.417652:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b28157174b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.417672:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480200/0xcbad34b2815716e2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000615 expref: 29 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.417680:0:5849:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b28157174b lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.417715:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480200/0xcbad34b2815716e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.46@tcp remote: 0x566877b057000615 expref: 29 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.417729:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480200/0xcbad34b2815716e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000615 expref: 29 pid: 5845 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710872.417940:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51fa2cc700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5849:1877696177053184:192.168.206.46@tcp:104: 00000100:00100000:0.0:1790710872.418106:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f4ecf240 going to sleep for 11 seconds 00000100:00100000:0.0:1790710872.420655:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51fa2cc700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5849:1877696177053184:192.168.206.46@tcp:104: 00010000:00010000:0.0:1790710872.420684:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b28157174b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710872.422374:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710872.422462:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158174080 00000100:00100000:3.0:1790710872.422471:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158174080 00010000:00010000:3.0:1790710872.422507:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480200/0xcbad34b2815716e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000615 expref: 30 pid: 5845 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710872.422536:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 61 00000100:00100000:3.0:1790710872.422545:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f400b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+30:2358:x1877696158174080:12345-192.168.206.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790710872.422560:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790710872.422567:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480200/0xcbad34b2815716e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000615 expref: 30 pid: 5845 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710872.422578:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480200/0xcbad34b2815716e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000615 expref: 30 pid: 5845 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710872.422597:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480200/0xcbad34b2815716e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000615 expref: 30 pid: 5845 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710872.422611:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c51d8e33600) 00010000:00010000:3.0:1790710872.422616:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b28157174b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710872.422625:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b28157174b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710872.422632:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b28157174b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710872.422676:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790710872.422733:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f400b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+29:2358:x1877696158174080:12345-192.168.206.46@tcp:103:ldlm_bl.0 Request processed in 188us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710872.422740:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 61 00010000:00010000:2.0:1790710872.422836:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b28157174b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710872.422845:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b28157174b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790710872.423382:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967427 00000001:00080000:2.0:1790710872.423588:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:2.0:1790710872.423687:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4009180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5849:1877696177053312:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1790710872.423732:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710872.423763:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f4013d80 going to sleep for 11 seconds 00000100:00100000:3.0:1790710872.423813:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177053312 00000100:00100000:3.0:1790710872.423818:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177053312 00000100:00100000:3.0:1790710872.423865:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790710872.423872:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4009880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5849:x1877696177053312:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1790710872.423945:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4009880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5849:x1877696177053312:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 72us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710872.423952:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1790710872.423995:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790710872.424065:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4009180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5849:1877696177053312:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1790710872.424664:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:0.0:1790710872.424724:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51fa2cc700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5849:1877696177053440:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1790710872.424876:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710872.424946:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f4ecfc00 going to sleep for 11 seconds 00000100:00100000:3.0:1790710872.425038:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177053440 00000100:00100000:3.0:1790710872.425043:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177053440 00000100:00100000:3.0:1790710872.425117:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790710872.425156:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51fa2cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5849:x1877696177053440:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1790710872.425308:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51fa2cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5849:x1877696177053440:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 154us (430us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1790710872.425315:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790710872.425379:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51fa2cc700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5849:1877696177053440:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1790710872.425421:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:0.0:1790710872.425456:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b28157174b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.425466:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b28157174b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.425474:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b28157174b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.425489:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c243b800 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1790710872.425494:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b28157174b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.425501:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b28157174b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.425516:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c51d8e33600) 00010000:00010000:0.0:1790710872.425518:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1790710872.425523:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b28157174b lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.425529:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b28157174b lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790710872.425672:0:5849:0:(mdd_object.c:4180:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1790710872.425783:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:0.0:1790710872.425794:0:5849:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 349762665521ns, next at 350762663734ns, rc = 0 00000001:00080000:0.0:1790710872.425799:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:0.0:1790710872.425827:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c51d8e33600) 00010000:00010000:0.0:1790710872.425830:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1790710872.425837:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645800/0xcbad34b281571736 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700063f expref: 33 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710872.425940:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d6261c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+32:11348:x1877696158173952:12345-192.168.206.46@tcp:35:lfs.0 Request processed in 12324us (13058us total) trans 4294967432 rc 0/0 00000100:00100000:0.0:1790710872.425948:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 38 00000020:00080000:0.0:1790710872.425952:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1790710872.428242:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710872.428412:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158174208 00000100:00100000:3.0:1790710872.428420:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158174208 00000100:00100000:3.0:1790710872.428467:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 147 00000100:00100000:3.0:1790710872.428475:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4008380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+32:11348:x1877696158174208:12345-192.168.206.46@tcp:101:lfs.0 00010000:00010000:3.0:1790710872.428495:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790710872.428515:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645e00/0xcbad34b281571752 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b057000646 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710872.428588:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645e00/0xcbad34b281571752 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000646 expref: 33 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710872.428602:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645e00/0xcbad34b281571752 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000646 expref: 33 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710872.428618:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c51c2c2e800) 00010000:00010000:3.0:1790710872.428621:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790710872.428625:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c1645e00, rc 0) 00000100:00100000:3.0:1790710872.428674:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4008380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+33:11348:x1877696158174208:12345-192.168.206.46@tcp:101:lfs.0 Request processed in 200us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710872.428680:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 147 00000100:00100000:1.0:1790710872.432282:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710872.432404:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158174464 00000100:00100000:2.0:1790710872.432413:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158174464 00000100:00100000:2.0:1790710872.432466:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 39 00000100:00100000:2.0:1790710872.432475:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+33:11348:x1877696158174464:12345-192.168.206.46@tcp:35:lfs.0 00000100:00100000:2.0:1790710872.432711:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+34:11348:x1877696158174464:12345-192.168.206.46@tcp:35:lfs.0 Request processed in 236us (435us total) trans 4294967433 rc 0/0 00000100:00100000:2.0:1790710872.432718:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 39 00000100:00100000:0.0:1790710872.512041:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710872.512174:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158174720 00000100:00100000:1.0:1790710872.512184:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158174720 00000100:00100000:1.0:1790710872.512237:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 148 00000100:00100000:1.0:1790710872.512246:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51fa2cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+34:11358:x1877696158174720:12345-192.168.206.46@tcp:101:lfs.0 00010000:00010000:1.0:1790710872.512269:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790710872.512288:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b281571759 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b05700064d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790710872.512382:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1790710872.512498:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b281571759 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700064d expref: 36 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710872.512512:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c51c2c2ec00) 00010000:00010000:1.0:1790710872.512514:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790710872.512535:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b281571759 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700064d expref: 36 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710872.512549:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c6481c00, rc 0) 00000100:00100000:1.0:1790710872.512614:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51fa2cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+35:11358:x1877696158174720:12345-192.168.206.46@tcp:101:lfs.0 Request processed in 369us (582us total) trans 4294967434 rc 301/301 00000100:00100000:1.0:1790710872.512622:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 148 00000100:00100000:3.0:1790710872.516246:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710872.516432:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158174848 00000100:00100000:0.0:1790710872.516441:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158174848 00000100:00100000:0.0:1790710872.516496:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 149 00000100:00100000:0.0:1790710872.516506:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4cf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+35:11358:x1877696158174848:12345-192.168.206.46@tcp:34:lfs.0 00010000:00010000:0.0:1790710872.516580:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b281571767 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.516595:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b281571767 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.516605:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b281571767 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.516618:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243bc00/0xcbad34b28157176e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.516624:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243bc00/0xcbad34b28157176e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.516636:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243bc00/0xcbad34b28157176e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.516717:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ba00/0xcbad34b281571775 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.516724:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ba00/0xcbad34b281571775 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.516730:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ba00/0xcbad34b281571775 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790710872.516763:0:5846:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ba00/0xcbad34b281571775 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.516772:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b281571767 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.516778:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b281571767 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.516784:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b281571767 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.516789:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c243b800 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1790710872.516792:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b281571767 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.516799:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b281571767 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.516809:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c51cca25000) 00010000:00010000:0.0:1790710872.516817:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790710872.516821:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b281571767 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.516826:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b281571767 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.516839:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243bc00/0xcbad34b28157176e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.516844:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243bc00/0xcbad34b28157176e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.516849:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243bc00/0xcbad34b28157176e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.516853:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c243bc00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1790710872.516856:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243bc00/0xcbad34b28157176e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.516860:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243bc00/0xcbad34b28157176e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.516866:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c51e4efb000) 00010000:00010000:0.0:1790710872.516867:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790710872.516870:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243bc00/0xcbad34b28157176e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.516874:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243bc00/0xcbad34b28157176e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.516886:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ba00/0xcbad34b281571775 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.516895:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ba00/0xcbad34b281571775 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.516901:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ba00/0xcbad34b281571775 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.516905:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c243ba00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1790710872.516907:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ba00/0xcbad34b281571775 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.516912:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ba00/0xcbad34b281571775 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.516918:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c51c2c2e800) 00010000:00010000:0.0:1790710872.516919:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790710872.516922:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ba00/0xcbad34b281571775 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.516927:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ba00/0xcbad34b281571775 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710872.517009:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4cf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+35:11358:x1877696158174848:12345-192.168.206.46@tcp:34:lfs.0 Request processed in 505us (770us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710872.517016:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 149 00000100:00100000:2.0:1790710872.519808:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710872.519875:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158175104 00000100:00100000:0.0:1790710872.519883:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158175104 00000100:00100000:0.0:1790710872.519932:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 40 00000100:00100000:0.0:1790710872.519941:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f400ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+35:11358:x1877696158175104:12345-192.168.206.46@tcp:35:lfs.0 00000100:00100000:0.0:1790710872.520186:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f400ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+36:11358:x1877696158175104:12345-192.168.206.46@tcp:35:lfs.0 Request processed in 246us (385us total) trans 4294967435 rc 0/0 00000100:00100000:0.0:1790710872.520203:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 40 00000100:00100000:1.0:1790710872.582698:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710872.582796:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158175360 00000100:00100000:0.0:1790710872.582805:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158175360 00000100:00100000:0.0:1790710872.582862:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 150 00000100:00100000:0.0:1790710872.582871:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+36:11361:x1877696158175360:12345-192.168.206.46@tcp:101:lfs.0 00010000:00010000:0.0:1790710872.582893:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790710872.582912:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ba00/0xcbad34b28157177c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b057000654 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.582993:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243bc00/0xcbad34b281571783 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.583006:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243bc00/0xcbad34b281571783 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.583016:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243bc00/0xcbad34b281571783 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.583027:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b28157178a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.583033:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b28157178a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.583039:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b28157178a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.583192:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243be00/0xcbad34b281571791 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.583217:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243be00/0xcbad34b281571791 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.583223:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243be00/0xcbad34b281571791 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790710872.583233:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1790710872.583321:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243bc00/0xcbad34b281571783 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.583328:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243bc00/0xcbad34b281571783 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.583336:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243bc00/0xcbad34b281571783 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.583341:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c243bc00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1790710872.583345:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243bc00/0xcbad34b281571783 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.583352:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243bc00/0xcbad34b281571783 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.583364:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c51cca25000) 00010000:00010000:0.0:1790710872.583367:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790710872.583372:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243bc00/0xcbad34b281571783 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.583377:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243bc00/0xcbad34b281571783 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.583390:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b28157178a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.583402:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b28157178a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.583409:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b28157178a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.583426:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c243b800 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1790710872.583430:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b28157178a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.583436:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b28157178a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.583443:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c51e4efb000) 00010000:00010000:0.0:1790710872.583446:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790710872.583449:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b28157178a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.583455:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b28157178a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.583494:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ba00/0xcbad34b28157177c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000654 expref: 39 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.583505:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243be00/0xcbad34b281571791 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000654 expref: 38 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.583512:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c51c2c2e800) 00010000:00010000:0.0:1790710872.583514:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790710872.583522:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c243be00, rc 0) 00000100:00100000:0.0:1790710872.583585:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+38:11361:x1877696158175360:12345-192.168.206.46@tcp:101:lfs.0 Request processed in 715us (895us total) trans 4294967436 rc 0/0 00000100:00100000:0.0:1790710872.583593:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 150 00010000:00010000:0.0:1790710872.584812:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790710872.588020:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710872.588170:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158175488 00000100:00100000:0.0:1790710872.588179:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158175488 00000100:00100000:0.0:1790710872.588232:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 151 00000100:00100000:0.0:1790710872.588241:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4cf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+38:11361:x1877696158175488:12345-192.168.206.46@tcp:54:lfs.0 00010000:00010000:0.0:1790710872.588303:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ae00/0xcbad34b28157179f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.588320:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ae00/0xcbad34b28157179f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.588330:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ae00/0xcbad34b28157179f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.588355:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ae00/0xcbad34b28157179f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.588362:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ae00/0xcbad34b28157179f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.588369:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ae00/0xcbad34b28157179f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.588375:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c243ae00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1790710872.588378:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ae00/0xcbad34b28157179f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.588402:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ae00/0xcbad34b28157179f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.588580:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c51c2c2e800) 00010000:00010000:0.0:1790710872.588584:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790710872.588589:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ae00/0xcbad34b28157179f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.588596:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ae00/0xcbad34b28157179f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710872.588672:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4cf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+38:11361:x1877696158175488:12345-192.168.206.46@tcp:54:lfs.0 Request processed in 432us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710872.588680:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 151 00000100:00100000:2.0:1790710872.592821:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710872.592899:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158175744 00000100:00100000:0.0:1790710872.592907:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158175744 00000100:00100000:0.0:1790710872.592957:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 41 00000100:00100000:0.0:1790710872.592966:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f400b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+38:11361:x1877696158175744:12345-192.168.206.46@tcp:35:lfs.0 00000100:00100000:0.0:1790710872.593217:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f400b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+39:11361:x1877696158175744:12345-192.168.206.46@tcp:35:lfs.0 Request processed in 251us (403us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1790710872.593225:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 41 00000001:00080000:3.0:1790710872.897598:0:6720:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:3.0:1790710872.897617:0:6720:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000100:00100000:2.0:1790710872.964587:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710872.964680:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158176000 00000100:00100000:0.0:1790710872.964690:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158176000 00000100:00100000:0.0:1790710872.964752:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 152 00000100:00100000:0.0:1790710872.964762:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f400a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+39:11392:x1877696158176000:12345-192.168.206.46@tcp:101:cat.0 00010000:00010000:0.0:1790710872.964787:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790710872.964807:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ae00/0xcbad34b2815717a6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b05700065b expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.964916:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ba00/0xcbad34b2815717ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.964931:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ba00/0xcbad34b2815717ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.964945:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ba00/0xcbad34b2815717ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790710872.964956:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1790710872.965077:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ae00/0xcbad34b2815717a6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700065b expref: 42 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.965095:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ba00/0xcbad34b2815717ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700065b expref: 41 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.965103:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c51c2c2e800) 00010000:00010000:0.0:1790710872.965106:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790710872.965109:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c243ba00, rc 0) 00000100:00100000:2.0:1790710872.965608:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f400a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+41:11392:x1877696158176000:12345-192.168.206.46@tcp:101:cat.0 Request processed in 845us (1027us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1790710872.965616:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 152 00000100:00100000:3.0:1790710872.971734:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710872.971782:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710872.971873:0:8449:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158176128 00000100:00100000:0.0:1790710872.971884:0:8449:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158176128 00000100:00100000:0.0:1790710872.971949:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 12 00000100:00100000:0.0:1790710872.971958:0:8449:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4cf1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+41:2359:x1877696158176128:12345-192.168.206.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790710872.971978:0:8449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790710872.972002:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ba00/0xcbad34b2815717ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700065b expref: 41 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710872.972039:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c51c2c2e800) 00010000:00010000:0.0:1790710872.972043:0:8449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790710872.972103:0:8449:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4cf1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+40:2359:x1877696158176128:12345-192.168.206.46@tcp:103:ldlm_bl.0 Request processed in 146us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710872.972111:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 12 00000100:00100000:2.0:1790710872.972339:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158176384 00000100:00100000:2.0:1790710872.972344:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158176384 00000100:00100000:2.0:1790710872.972379:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 42 00000100:00100000:2.0:1790710872.972386:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4cf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+40:11392:x1877696158176384:12345-192.168.206.46@tcp:35:cat.0 00000100:00100000:2.0:1790710872.972678:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4cf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+41:11392:x1877696158176384:12345-192.168.206.46@tcp:35:cat.0 Request processed in 291us (894us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1790710872.972695:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 42 00000100:00100000:1.0:1790710873.030533:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710873.030635:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158176640 00000100:00100000:0.0:1790710873.030645:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158176640 00000100:00100000:0.0:1790710873.030703:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 153 00000100:00100000:0.0:1790710873.030712:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff87c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+41:11398:x1877696158176640:12345-192.168.206.46@tcp:101:dd.0 00010000:00010000:0.0:1790710873.030734:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790710873.030745:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1790710873.030770:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1644a00/0xcbad34b281571713 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000631 expref: 41 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710873.030790:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c51cca25000) 00010000:00010000:0.0:1790710873.030794:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790710873.030805:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ba00/0xcbad34b2815717bb lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b057000662 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710873.030891:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ae00/0xcbad34b2815717c2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710873.030905:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243be00/0xcbad34b281571791 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000654 expref: 41 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710873.030913:0:5846:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ae00/0xcbad34b2815717c2 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710873.030953:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243be00/0xcbad34b281571791 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.46@tcp remote: 0x566877b057000654 expref: 41 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710873.030965:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243be00/0xcbad34b281571791 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000654 expref: 41 pid: 5845 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710873.030990:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51fa2cf480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1877696177053568:192.168.206.46@tcp:104: 00000100:00100000:0.0:1790710873.031074:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51d8e1ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1790710873.034332:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710873.034499:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158176768 00000100:00100000:1.0:1790710873.034509:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158176768 00010000:00010000:1.0:1790710873.034547:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243be00/0xcbad34b281571791 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000654 expref: 42 pid: 5845 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710873.034586:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 62 00000100:00100000:1.0:1790710873.034596:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4cf0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+42:2359:x1877696158176768:12345-192.168.206.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790710873.034611:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790710873.034623:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243be00/0xcbad34b281571791 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000654 expref: 42 pid: 5845 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710873.034636:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243be00/0xcbad34b281571791 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000654 expref: 42 pid: 5845 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710873.034657:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c51c2c2e800) 00010000:00010000:1.0:1790710873.034662:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ae00/0xcbad34b2815717c2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710873.034672:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ae00/0xcbad34b2815717c2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710873.034692:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ae00/0xcbad34b2815717c2 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710873.034709:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790710873.034760:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4cf0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+42:2359:x1877696158176768:12345-192.168.206.46@tcp:103:ldlm_bl.0 Request processed in 165us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710873.034767:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 62 00010000:00010000:0.0:1790710873.038823:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243be00/0xcbad34b281571791 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000654 expref: 41 pid: 5845 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710873.038846:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51fa2cf480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1877696177053568:192.168.206.46@tcp:104: 00010000:00010000:0.0:1790710873.038868:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ae00/0xcbad34b2815717c2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710873.038878:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ae00/0xcbad34b2815717c2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710873.038884:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ae00/0xcbad34b2815717c2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790710873.038904:0:5846:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1790710873.039266:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ba00/0xcbad34b2815717bb lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000662 expref: 42 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710873.039281:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ae00/0xcbad34b2815717c2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000662 expref: 41 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710873.039306:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c51c2c2e800) 00010000:00010000:0.0:1790710873.039309:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790710873.039313:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c243ae00, rc 0) 00000100:00100000:0.0:1790710873.039623:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff87c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+41:11398:x1877696158176640:12345-192.168.206.46@tcp:101:dd.0 Request processed in 8910us (9097us total) trans 4294967440 rc 0/0 00000100:00100000:0.0:1790710873.039632:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 153 00000100:00100000:3.0:1790710873.044326:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710873.044510:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158177024 00000100:00100000:0.0:1790710873.044519:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158177024 00000100:00100000:0.0:1790710873.044580:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 154 00000100:00100000:0.0:1790710873.044591:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+41:11398:x1877696158177024:12345-192.168.206.46@tcp:36:dd.0 00010000:00010000:0.0:1790710873.044865:0:8060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b2815717d0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710873.044882:0:8060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b2815717d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710873.044893:0:8060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b2815717d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790710873.045442:0:8060:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967441 00000004:00010000:1.0:1790710873.045481:0:8060:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000024b9c0fd reply state 00000000ca7a1f39 transno 4294967442 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b2815717d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710873.045492:0:8060:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790710873.045646:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+44:11398:x1877696158177024:12345-192.168.206.46@tcp:36:dd.0 Request processed in 1054us (1329us total) trans 4294967442 rc 0/0 00000100:00100000:1.0:1790710873.045654:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 154 00000020:00080000:1.0:1790710873.045659:0:8060:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1790710873.052747:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b2815717d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710873.052765:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b2815717d0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710873.052773:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b2815717d0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710873.052795:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c243b800 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1790710873.052800:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b2815717d0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710873.052808:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b2815717d0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710873.052825:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c51c2c2e800) 00010000:00010000:3.0:1790710873.052828:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790710873.052832:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b2815717d0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710873.052839:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b2815717d0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710873.342173:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710873.342374:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158177152 00000100:00100000:2.0:1790710873.342386:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158177152 00000100:00100000:2.0:1790710873.342446:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 155 00000100:00100000:2.0:1790710873.342456:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4cf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+43:11412:x1877696158177152:12345-192.168.206.46@tcp:101:stat.0 00010000:00010000:2.0:1790710873.342481:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790710873.342502:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b2815717d7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b057000669 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710873.342568:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b2815717de lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710873.342584:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b2815717de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710873.342596:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b2815717de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710873.342609:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b2815717e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710873.342616:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b2815717e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710873.342622:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b2815717e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710873.342706:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b2815717ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710873.342734:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ae00/0xcbad34b2815717c2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000662 expref: 44 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710873.342741:0:5847:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b2815717ec lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710873.342771:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ae00/0xcbad34b2815717c2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.46@tcp remote: 0x566877b057000662 expref: 44 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710873.342784:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ae00/0xcbad34b2815717c2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000662 expref: 44 pid: 5846 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710873.342797:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f400b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1877696177053696:192.168.206.46@tcp:104: 00000100:00100000:2.0:1790710873.342884:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f4013240 going to sleep for 11 seconds 00000100:00100000:2.0:1790710873.346242:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710873.346464:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f400b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1877696177053696:192.168.206.46@tcp:104: 00010000:00010000:3.0:1790710873.346491:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b2815717ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710873.346567:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158177408 00000100:00100000:0.0:1790710873.346574:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158177408 00000100:00100000:0.0:1790710873.346626:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 43 00000100:00100000:0.0:1790710873.346635:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f400a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+45:5593:x1877696158177408:12345-192.168.206.46@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1790710873.347476:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f400a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+46:5593:x1877696158177408:12345-192.168.206.46@tcp:35:ldlm_bl.0 Request processed in 331us (733us total) trans 4294967443 rc 0/0 00000100:00100000:0.0:1790710873.347486:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 43 00000100:00100000:1.0:1790710873.349221:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710873.349307:0:8449:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158177536 00000100:00100000:0.0:1790710873.349316:0:8449:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158177536 00010000:00010000:0.0:1790710873.349356:0:8449:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ae00/0xcbad34b2815717c2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000662 expref: 46 pid: 5846 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710873.349393:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 63 00000100:00100000:0.0:1790710873.349402:0:8449:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8e5c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+46:2358:x1877696158177536:12345-192.168.206.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790710873.349418:0:8449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790710873.349424:0:8449:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ae00/0xcbad34b2815717c2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000662 expref: 46 pid: 5846 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710873.349436:0:8449:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ae00/0xcbad34b2815717c2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000662 expref: 46 pid: 5846 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710873.349455:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ae00/0xcbad34b2815717c2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000662 expref: 46 pid: 5846 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710873.349471:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c51c2c2e800) 00010000:00010000:0.0:1790710873.349476:0:8449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b2815717ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710873.349485:0:8449:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b2815717ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710873.349492:0:8449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b2815717ec lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710873.349520:0:8449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790710873.349567:0:8449:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8e5c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+45:2358:x1877696158177536:12345-192.168.206.46@tcp:103:ldlm_bl.0 Request processed in 166us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710873.349586:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 63 00010000:00010000:3.0:1790710873.349934:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b2815717ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710873.349944:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b2815717ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790710873.349992:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1790710873.349997:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790710873.350020:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b2815717ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710873.350043:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b2815717ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710873.350053:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b2815717de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710873.350060:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b2815717de lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710873.350067:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b2815717de lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710873.350073:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c8047800 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1790710873.350077:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b2815717de lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710873.350085:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b2815717de lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710873.350094:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c51cca25000) 00010000:00010000:3.0:1790710873.350096:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790710873.350100:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b2815717de lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710873.350105:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b2815717de lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710873.350171:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b2815717e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710873.350178:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b2815717e5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710873.350191:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b2815717e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710873.350195:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c8046e00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1790710873.350198:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b2815717e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710873.350204:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b2815717e5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710873.350211:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c51cca25200) 00010000:00010000:3.0:1790710873.350213:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790710873.350216:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b2815717e5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710873.350221:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b2815717e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710873.350257:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b2815717d7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000669 expref: 45 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710873.350270:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b2815717ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000669 expref: 44 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710873.350277:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c51c2c2e800) 00010000:00010000:3.0:1790710873.350279:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790710873.350281:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c8047a00, rc 0) 00000100:00100000:3.0:1790710873.350324:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4cf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+44:11412:x1877696158177152:12345-192.168.206.46@tcp:101:stat.0 Request processed in 7869us (8160us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710873.350339:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 155 00000100:00100000:1.0:1790710873.413380:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710873.413475:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158177792 00000100:00100000:2.0:1790710873.413484:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158177792 00000100:00100000:2.0:1790710873.413541:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 156 00000100:00100000:2.0:1790710873.413551:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff87df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+44:11418:x1877696158177792:12345-192.168.206.46@tcp:36:truncate.0 00010000:00010000:2.0:1790710873.413609:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790710873.413636:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b2815717ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000669 expref: 44 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710873.413655:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c51c2c2e800) 00010000:00010000:2.0:1790710873.413660:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790710873.413852:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c13fc400/0xcbad34b2815717f3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710873.413879:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c13fc400/0xcbad34b2815717f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710873.413888:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c13fc400/0xcbad34b2815717f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790710873.413937:0:5845:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967444 00000004:00010000:2.0:1790710873.413959:0:5845:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000004b2d5e1f reply state 00000000daa64be2 transno 4294967445 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c13fc400/0xcbad34b2815717f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710873.413979:0:5845:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790710873.414069:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff87df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+46:11418:x1877696158177792:12345-192.168.206.46@tcp:36:truncate.0 Request processed in 519us (697us total) trans 4294967445 rc 0/0 00000100:00100000:2.0:1790710873.414076:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 156 00000020:00080000:2.0:1790710873.414080:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1790710873.416293:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c13fc400/0xcbad34b2815717f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710873.416310:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c13fc400/0xcbad34b2815717f3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710873.416317:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c13fc400/0xcbad34b2815717f3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710873.416336:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c13fc400 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1790710873.416341:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c13fc400/0xcbad34b2815717f3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710873.416349:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c13fc400/0xcbad34b2815717f3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710873.416363:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c51c2c2e800) 00010000:00010000:0.0:1790710873.416366:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790710873.416369:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c13fc400/0xcbad34b2815717f3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710873.416375:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c13fc400/0xcbad34b2815717f3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710873.571342:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710873.571584:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158177920 00000100:00100000:0.0:1790710873.571594:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158177920 00000100:00100000:0.0:1790710873.571650:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 157 00000100:00100000:0.0:1790710873.571659:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff87ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+45:11432:x1877696158177920:12345-192.168.206.46@tcp:101:stat.0 00010000:00010000:0.0:1790710873.571683:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790710873.571716:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ae00/0xcbad34b2815717fa lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b057000670 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710873.571781:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ba00/0xcbad34b281571801 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710873.571806:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ba00/0xcbad34b281571801 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710873.571817:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ba00/0xcbad34b281571801 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710873.571833:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243be00/0xcbad34b281571808 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710873.571840:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243be00/0xcbad34b281571808 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710873.571847:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243be00/0xcbad34b281571808 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710873.571929:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243bc00/0xcbad34b28157180f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710873.571938:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243bc00/0xcbad34b28157180f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710873.571945:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243bc00/0xcbad34b28157180f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790710873.571989:0:5846:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1790710873.571993:0:5846:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790710873.572011:0:5846:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243bc00/0xcbad34b28157180f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710873.572028:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243bc00/0xcbad34b28157180f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710873.572036:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ba00/0xcbad34b281571801 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710873.572043:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ba00/0xcbad34b281571801 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710873.572051:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ba00/0xcbad34b281571801 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710873.572057:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c243ba00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1790710873.572061:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ba00/0xcbad34b281571801 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710873.572068:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ba00/0xcbad34b281571801 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710873.572080:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c51cca25000) 00010000:00010000:0.0:1790710873.572083:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790710873.572087:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ba00/0xcbad34b281571801 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710873.572094:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ba00/0xcbad34b281571801 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710873.572106:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243be00/0xcbad34b281571808 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710873.572112:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243be00/0xcbad34b281571808 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710873.572186:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243be00/0xcbad34b281571808 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710873.572192:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c243be00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1790710873.572195:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243be00/0xcbad34b281571808 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710873.572201:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243be00/0xcbad34b281571808 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710873.572209:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c51e4efbd00) 00010000:00010000:0.0:1790710873.572211:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790710873.572214:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243be00/0xcbad34b281571808 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710873.572219:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243be00/0xcbad34b281571808 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710873.572248:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ae00/0xcbad34b2815717fa lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000670 expref: 47 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710873.572260:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243bc00/0xcbad34b28157180f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000670 expref: 46 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710873.572267:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c51c2c2e800) 00010000:00010000:0.0:1790710873.572269:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790710873.572272:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c243bc00, rc 0) 00000100:00100000:0.0:1790710873.572332:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff87ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+46:11432:x1877696158177920:12345-192.168.206.46@tcp:101:stat.0 Request processed in 673us (1013us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710873.572348:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 157 00010000:00010000:3.0:1790710873.607309:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790710873.659806:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710873.659906:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158178176 00000100:00100000:1.0:1790710873.659916:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158178176 00000100:00100000:1.0:1790710873.659985:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 158 00000100:00100000:1.0:1790710873.659996:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f400aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+46:11443:x1877696158178176:12345-192.168.206.46@tcp:101:lfs.0 00010000:00010000:1.0:1790710873.660016:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790710873.660034:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571816 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b057000677 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790710873.660163:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1790710873.660319:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571816 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000677 expref: 48 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710873.660344:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c51c2c2ec00) 00010000:00010000:1.0:1790710873.660348:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790710873.660353:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571816 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000677 expref: 48 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710873.660367:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c6480c00, rc 0) 00000100:00100000:1.0:1790710873.660427:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f400aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+47:11443:x1877696158178176:12345-192.168.206.46@tcp:101:lfs.0 Request processed in 433us (632us total) trans 4294967446 rc 301/301 00000100:00100000:1.0:1790710873.660433:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 158 00000100:00100000:2.0:1790710873.667857:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710873.667942:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158178432 00000100:00100000:0.0:1790710873.667952:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158178432 00000100:00100000:0.0:1790710873.668006:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 44 00000100:00100000:0.0:1790710873.668016:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d6260050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+47:11443:x1877696158178432:12345-192.168.206.46@tcp:35:lfs.0 00000100:00100000:2.0:1790710873.669385:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d6260050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+48:11443:x1877696158178432:12345-192.168.206.46@tcp:35:lfs.0 Request processed in 1364us (1531us total) trans 4294967447 rc 0/0 00000100:00100000:2.0:1790710873.669398:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 44 00000100:00100000:2.0:1790710873.748910:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710873.749691:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158178688 00000100:00100000:0.0:1790710873.749702:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158178688 00000100:00100000:0.0:1790710873.749810:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 159 00000100:00100000:0.0:1790710873.749820:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f400ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+48:11449:x1877696158178688:12345-192.168.206.46@tcp:101:bash.0 00010000:00010000:0.0:1790710873.749844:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790710873.749865:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ae00/0xcbad34b281571824 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b05700067e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710873.749984:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243be00/0xcbad34b28157182b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710873.750001:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243bc00/0xcbad34b28157180f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000670 expref: 49 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710873.750014:0:5846:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243be00/0xcbad34b28157182b lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710873.750053:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243bc00/0xcbad34b28157180f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.46@tcp remote: 0x566877b057000670 expref: 49 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710873.750069:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243bc00/0xcbad34b28157180f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000670 expref: 49 pid: 5846 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710873.750103:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51fa2cc000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1877696177053824:192.168.206.46@tcp:104: 00000100:00100000:0.0:1790710873.750254:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51d8e1ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1790710873.758356:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710873.758670:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158178816 00000100:00100000:1.0:1790710873.758679:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158178816 00010000:00010000:1.0:1790710873.758715:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243bc00/0xcbad34b28157180f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000670 expref: 50 pid: 5846 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710873.758747:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 64 00000100:00100000:1.0:1790710873.758754:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4cf2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+50:2358:x1877696158178816:12345-192.168.206.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790710873.758767:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790710873.758773:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243bc00/0xcbad34b28157180f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000670 expref: 50 pid: 5846 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710873.758786:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243bc00/0xcbad34b28157180f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000670 expref: 50 pid: 5846 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710873.758807:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c51c2c2e800) 00010000:00010000:1.0:1790710873.758824:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243be00/0xcbad34b28157182b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710873.758834:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243be00/0xcbad34b28157182b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710873.758842:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243be00/0xcbad34b28157182b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710873.758858:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790710873.758909:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4cf2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+50:2358:x1877696158178816:12345-192.168.206.46@tcp:103:ldlm_bl.0 Request processed in 155us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710873.758916:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 64 00010000:00010000:0.0:1790710873.762244:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243bc00/0xcbad34b28157180f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000670 expref: 49 pid: 5846 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710873.762617:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51fa2cc000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1877696177053824:192.168.206.46@tcp:104: 00010000:00010000:0.0:1790710873.762641:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243be00/0xcbad34b28157182b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710873.762652:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243be00/0xcbad34b28157182b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710873.762658:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243be00/0xcbad34b28157182b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790710873.762679:0:5846:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1790710873.762850:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ae00/0xcbad34b281571824 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700067e expref: 50 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710873.762866:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243be00/0xcbad34b28157182b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700067e expref: 49 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710873.762875:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c51c2c2e800) 00010000:00010000:0.0:1790710873.762878:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790710873.762881:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c243be00, rc 0) 00000100:00100000:0.0:1790710873.762956:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f400ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+49:11449:x1877696158178688:12345-192.168.206.46@tcp:101:bash.0 Request processed in 13137us (14053us total) trans 4294967448 rc 0/0 00000100:00100000:0.0:1790710873.762971:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 159 00000100:00100000:3.0:1790710873.769091:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710873.769171:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158179072 00000100:00100000:1.0:1790710873.769180:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158179072 00000100:00100000:1.0:1790710873.769244:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 160 00000100:00100000:1.0:1790710873.769254:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4cf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+49:11449:x1877696158179072:12345-192.168.206.46@tcp:36:bash.0 00010000:00010000:1.0:1790710873.769498:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571839 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710873.769526:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571839 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710873.769538:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571839 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790710873.769589:0:5845:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967449 00000004:00010000:1.0:1790710873.769611:0:5845:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000defaf680 reply state 00000000d13ef652 transno 4294967450 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571839 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710873.769619:0:5845:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790710873.769719:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4cf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+52:11449:x1877696158179072:12345-192.168.206.46@tcp:36:bash.0 Request processed in 466us (643us total) trans 4294967450 rc 0/0 00000100:00100000:1.0:1790710873.769726:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 160 00000020:00080000:1.0:1790710873.769730:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1790710873.772033:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571839 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710873.772049:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571839 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710873.772056:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571839 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710873.772062:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c6480c00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1790710873.772067:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571839 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710873.772074:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571839 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710873.772090:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c51c2c2e800) 00010000:00010000:0.0:1790710873.772093:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790710873.772097:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571839 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710873.772102:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571839 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710873.778991:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710873.779092:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158179200 00000100:00100000:2.0:1790710873.779101:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158179200 00000100:00100000:2.0:1790710873.779199:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 161 00000100:00100000:2.0:1790710873.779208:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4cf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+51:11449:x1877696158179200:12345-192.168.206.46@tcp:101:bash.0 00010000:00010000:2.0:1790710873.779232:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790710873.779253:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c13fc400/0xcbad34b281571840 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b057000685 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710873.779354:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c13fcc00/0xcbad34b281571847 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710873.779371:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243be00/0xcbad34b28157182b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700067e expref: 52 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710873.779381:0:5847:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c13fcc00/0xcbad34b281571847 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710873.779413:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243be00/0xcbad34b28157182b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.46@tcp remote: 0x566877b05700067e expref: 52 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710873.779426:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243be00/0xcbad34b28157182b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.46@tcp remote: 0x566877b05700067e expref: 52 pid: 5846 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710873.779438:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f400b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1877696177053952:192.168.206.46@tcp:104: 00000100:00100000:2.0:1790710873.779521:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f4013840 going to sleep for 11 seconds 00000100:00100000:2.0:1790710873.781995:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f400b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1877696177053952:192.168.206.46@tcp:104: 00010000:00010000:2.0:1790710873.782022:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c13fcc00/0xcbad34b281571847 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710873.783238:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710873.783673:0:8449:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158179328 00000100:00100000:0.0:1790710873.783681:0:8449:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158179328 00010000:00010000:0.0:1790710873.783732:0:8449:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243be00/0xcbad34b28157182b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.46@tcp remote: 0x566877b05700067e expref: 53 pid: 5846 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710873.783772:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 65 00000100:00100000:0.0:1790710873.783793:0:8449:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+53:2359:x1877696158179328:12345-192.168.206.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790710873.783807:0:8449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790710873.783814:0:8449:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243be00/0xcbad34b28157182b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.46@tcp remote: 0x566877b05700067e expref: 53 pid: 5846 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710873.783827:0:8449:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243be00/0xcbad34b28157182b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.46@tcp remote: 0x566877b05700067e expref: 53 pid: 5846 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710873.783847:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243be00/0xcbad34b28157182b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.46@tcp remote: 0x566877b05700067e expref: 53 pid: 5846 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710873.783863:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c51c2c2e800) 00010000:00010000:0.0:1790710873.783869:0:8449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c13fcc00/0xcbad34b281571847 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710873.783879:0:8449:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c13fcc00/0xcbad34b281571847 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710873.783888:0:8449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c13fcc00/0xcbad34b281571847 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710873.783919:0:8449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790710873.783953:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c13fcc00/0xcbad34b281571847 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710873.783964:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c13fcc00/0xcbad34b281571847 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710873.783980:0:8449:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+52:2359:x1877696158179328:12345-192.168.206.46@tcp:103:ldlm_bl.0 Request processed in 187us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710873.783989:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 65 00000004:00200000:2.0:1790710873.784004:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1790710873.784014:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790710873.784034:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c13fcc00/0xcbad34b281571847 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710873.784063:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c13fc400/0xcbad34b281571840 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000685 expref: 52 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710873.784079:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c13fcc00/0xcbad34b281571847 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000685 expref: 51 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710873.784086:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c51c2c2e800) 00010000:00010000:2.0:1790710873.784090:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790710873.784092:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c13fcc00, rc 0) 00000100:00100000:2.0:1790710873.784168:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4cf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+51:11449:x1877696158179200:12345-192.168.206.46@tcp:101:bash.0 Request processed in 4921us (5146us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710873.784176:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 161 00000100:00100000:3.0:1790710873.789672:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710873.791687:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158179584 00000100:00100000:2.0:1790710873.791700:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158179584 00000100:00100000:2.0:1790710873.791777:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 45 00000100:00100000:2.0:1790710873.791786:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4cf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+51:11449:x1877696158179584:12345-192.168.206.46@tcp:35:bash.0 00000100:00100000:2.0:1790710873.792022:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4cf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+52:11449:x1877696158179584:12345-192.168.206.46@tcp:35:bash.0 Request processed in 228us (2350us total) trans 4294967451 rc 0/0 00000100:00100000:2.0:1790710873.792030:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 45 00000100:00100000:1.0:1790710873.880281:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710873.880482:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158179840 00000100:00100000:2.0:1790710873.880492:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158179840 00000100:00100000:2.0:1790710873.880600:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 162 00000100:00100000:2.0:1790710873.880611:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff87fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+52:11459:x1877696158179840:12345-192.168.206.46@tcp:101:lfs.0 00010000:00010000:2.0:1790710873.880636:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790710873.880668:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c13fc400/0xcbad34b28157184e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b05700068c expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790710873.880751:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1790710873.880875:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c13fc400/0xcbad34b28157184e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700068c expref: 54 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710873.880889:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c51c2c2ec00) 00010000:00010000:2.0:1790710873.880893:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790710873.880898:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c13fc400/0xcbad34b28157184e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700068c expref: 54 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710873.880911:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c13fc400, rc 0) 00000100:00100000:2.0:1790710873.880977:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff87fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+53:11459:x1877696158179840:12345-192.168.206.46@tcp:101:lfs.0 Request processed in 368us (705us total) trans 4294967452 rc 301/301 00000100:00100000:2.0:1790710873.880985:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 162 00000100:00100000:0.0:1790710873.889098:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710873.889167:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158179968 00000100:00100000:2.0:1790710873.889177:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158179968 00000100:00100000:2.0:1790710873.889236:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 163 00000100:00100000:2.0:1790710873.889247:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51fa2cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+53:11459:x1877696158179968:12345-192.168.206.46@tcp:34:lfs.0 00010000:00010000:2.0:1790710873.889337:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8000/0xcbad34b28157185c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710873.889356:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8000/0xcbad34b28157185c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710873.889368:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8000/0xcbad34b28157185c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710873.889405:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8600/0xcbad34b281571863 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710873.889412:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8600/0xcbad34b281571863 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710873.889419:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8600/0xcbad34b281571863 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710873.889503:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9400/0xcbad34b28157186a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710873.889512:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9400/0xcbad34b28157186a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710873.889518:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9400/0xcbad34b28157186a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790710873.889556:0:5846:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9400/0xcbad34b28157186a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710873.889567:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8000/0xcbad34b28157185c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710873.889573:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8000/0xcbad34b28157185c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710873.889580:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8000/0xcbad34b28157185c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710873.889585:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51f43f8000 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1790710873.889589:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8000/0xcbad34b28157185c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710873.889603:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8000/0xcbad34b28157185c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710873.889614:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c51cca25000) 00010000:00010000:2.0:1790710873.889617:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790710873.889621:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8000/0xcbad34b28157185c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710873.889626:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8000/0xcbad34b28157185c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710873.889637:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8600/0xcbad34b281571863 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710873.889642:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8600/0xcbad34b281571863 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710873.889647:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8600/0xcbad34b281571863 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710873.889651:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51f43f8600 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1790710873.889654:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8600/0xcbad34b281571863 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710873.889660:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8600/0xcbad34b281571863 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710873.889665:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c51cca25a00) 00010000:00010000:2.0:1790710873.889667:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790710873.889669:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8600/0xcbad34b281571863 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710873.889681:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8600/0xcbad34b281571863 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710873.889694:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9400/0xcbad34b28157186a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710873.889709:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9400/0xcbad34b28157186a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710873.889715:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9400/0xcbad34b28157186a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710873.889719:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51f43f9400 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1790710873.889722:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9400/0xcbad34b28157186a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710873.889727:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9400/0xcbad34b28157186a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710873.889733:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c51c2c2e800) 00010000:00010000:2.0:1790710873.889735:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790710873.889737:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9400/0xcbad34b28157186a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710873.889741:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9400/0xcbad34b28157186a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710873.889807:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51fa2cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+53:11459:x1877696158179968:12345-192.168.206.46@tcp:34:lfs.0 Request processed in 562us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710873.889814:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 163 00000100:00100000:0.0:1790710873.897558:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710873.898607:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158180224 00000100:00100000:2.0:1790710873.898619:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158180224 00000100:00100000:2.0:1790710873.898683:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 46 00000100:00100000:2.0:1790710873.898695:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51fa2cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+53:11459:x1877696158180224:12345-192.168.206.46@tcp:35:lfs.0 00000100:00100000:2.0:1790710873.901927:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51fa2cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+54:11459:x1877696158180224:12345-192.168.206.46@tcp:35:lfs.0 Request processed in 3224us (4366us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1790710873.901942:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 46 00000100:00100000:1.0:1790710873.948528:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710873.948609:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158180480 00000100:00100000:3.0:1790710873.948619:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158180480 00000100:00100000:3.0:1790710873.948687:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 164 00000100:00100000:3.0:1790710873.948697:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff87d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+54:11462:x1877696158180480:12345-192.168.206.46@tcp:101:lfs.0 00010000:00010000:3.0:1790710873.948720:0:8060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790710873.948739:0:8060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281571871 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b057000693 expref: -99 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710873.948813:0:8060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1644a00/0xcbad34b281571878 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710873.948828:0:8060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1644a00/0xcbad34b281571878 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710873.948838:0:8060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1644a00/0xcbad34b281571878 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710873.948850:0:8060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645800/0xcbad34b28157187f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710873.948858:0:8060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645800/0xcbad34b28157187f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710873.948883:0:8060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645800/0xcbad34b28157187f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710873.949010:0:8060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b281571886 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710873.949019:0:8060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b281571886 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710873.949027:0:8060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b281571886 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790710873.949036:0:8060:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1790710873.949165:0:8060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1644a00/0xcbad34b281571878 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710873.949174:0:8060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1644a00/0xcbad34b281571878 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710873.949181:0:8060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1644a00/0xcbad34b281571878 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710873.949186:0:8060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c1644a00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1790710873.949191:0:8060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1644a00/0xcbad34b281571878 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710873.949198:0:8060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1644a00/0xcbad34b281571878 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710873.949210:0:8060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c51cca25000) 00010000:00010000:3.0:1790710873.949213:0:8060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790710873.949224:0:8060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1644a00/0xcbad34b281571878 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710873.949242:0:8060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1644a00/0xcbad34b281571878 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710873.949258:0:8060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645800/0xcbad34b28157187f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710873.949263:0:8060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645800/0xcbad34b28157187f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710873.949268:0:8060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645800/0xcbad34b28157187f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710873.949273:0:8060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c1645800 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1790710873.949275:0:8060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645800/0xcbad34b28157187f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710873.949291:0:8060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645800/0xcbad34b28157187f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710873.949299:0:8060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c51c2c2e900) 00010000:00010000:3.0:1790710873.949301:0:8060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790710873.949304:0:8060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645800/0xcbad34b28157187f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710873.949310:0:8060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645800/0xcbad34b28157187f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710873.949366:0:8060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281571871 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000693 expref: 57 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710873.949393:0:8060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b281571886 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000693 expref: 56 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710873.949401:0:8060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c51c2c2e800) 00010000:00010000:3.0:1790710873.951306:0:8060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790710873.951313:0:8060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c8047a00, rc 0) 00000100:00100000:3.0:1790710873.951589:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff87d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+56:11462:x1877696158180480:12345-192.168.206.46@tcp:101:lfs.0 Request processed in 2887us (3065us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1790710873.951599:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 164 00000100:00100000:0.0:1790710873.959212:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710873.960014:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158180608 00000100:00100000:1.0:1790710873.960024:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158180608 00000100:00100000:1.0:1790710873.960085:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 13 00000100:00100000:1.0:1790710873.960095:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51fa2ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+56:2358:x1877696158180608:12345-192.168.206.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790710873.960317:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790710873.960411:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b281571886 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000693 expref: 56 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710873.960434:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c51c2c2e800) 00010000:00010000:1.0:1790710873.960439:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790710873.960559:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51fa2ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+55:2358:x1877696158180608:12345-192.168.206.46@tcp:103:ldlm_bl.0 Request processed in 465us (1355us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710873.960579:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 13 00000100:00100000:3.0:1790710873.961920:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710873.961988:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158180736 00000100:00100000:0.0:1790710873.962019:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158180736 00000100:00100000:0.0:1790710873.962069:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 165 00000100:00100000:0.0:1790710873.962077:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+55:11462:x1877696158180736:12345-192.168.206.46@tcp:54:lfs.0 00010000:00010000:0.0:1790710873.962159:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243bc00/0xcbad34b281571894 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710873.962175:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243bc00/0xcbad34b281571894 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710873.962186:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243bc00/0xcbad34b281571894 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710873.962211:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243bc00/0xcbad34b281571894 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710873.962218:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243bc00/0xcbad34b281571894 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710873.962225:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243bc00/0xcbad34b281571894 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710873.962231:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c243bc00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1790710873.962236:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243bc00/0xcbad34b281571894 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710873.962243:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243bc00/0xcbad34b281571894 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710873.962257:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c51c2c2e800) 00010000:00010000:0.0:1790710873.962260:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790710873.962266:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243bc00/0xcbad34b281571894 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710873.962281:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243bc00/0xcbad34b281571894 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710873.962332:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+55:11462:x1877696158180736:12345-192.168.206.46@tcp:54:lfs.0 Request processed in 255us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710873.962339:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 165 00000100:00100000:3.0:1790710873.967317:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710873.968401:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158180992 00000100:00100000:0.0:1790710873.968414:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158180992 00000100:00100000:0.0:1790710873.968470:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 47 00000100:00100000:0.0:1790710873.968479:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4cf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+55:11462:x1877696158180992:12345-192.168.206.46@tcp:35:lfs.0 00000100:00100000:0.0:1790710873.968717:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4cf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+56:11462:x1877696158180992:12345-192.168.206.46@tcp:35:lfs.0 Request processed in 238us (1409us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1790710873.968724:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 47 00000100:00100000:2.0:1790710874.169828:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710874.169929:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158181248 00000100:00100000:1.0:1790710874.169939:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158181248 00000100:00100000:1.0:1790710874.170020:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 166 00000100:00100000:1.0:1790710874.170030:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f400b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+56:11480:x1877696158181248:12345-192.168.206.46@tcp:101:cat.0 00010000:00010000:1.0:1790710874.170053:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790710874.170074:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b28157189b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b05700069a expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710874.170204:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b2815718a2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710874.170228:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b2815718a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710874.170240:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b2815718a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790710874.170253:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000100:00080000:0.0:1790710874.170393:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1790710874.170621:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b28157189b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700069a expref: 59 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710874.170640:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b2815718a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700069a expref: 58 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710874.170649:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c51c2c2e800) 00010000:00010000:1.0:1790710874.170652:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1790710874.170655:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c6481000, rc 0) 00000100:00100000:1.0:1790710874.170763:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f400b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+58:11480:x1877696158181248:12345-192.168.206.46@tcp:101:cat.0 Request processed in 733us (943us total) trans 4294967456 rc 0/0 00000100:00100000:1.0:1790710874.170772:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 166 00000100:00100000:3.0:1790710874.209879:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710874.209997:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158181376 00000100:00100000:1.0:1790710874.210013:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158181376 00000100:00100000:1.0:1790710874.210088:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 167 00000100:00100000:1.0:1790710874.210099:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4cf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+58:11481:x1877696158181376:12345-192.168.206.46@tcp:101:lfs.0 00010000:00010000:1.0:1790710874.210168:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790710874.210187:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b2815718b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b0570006a1 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710874.210270:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481400/0xcbad34b2815718b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710874.210296:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481400/0xcbad34b2815718b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710874.210309:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481400/0xcbad34b2815718b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790710874.210353:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1790710874.210358:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790710874.210375:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481400/0xcbad34b2815718b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710874.210400:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b2815718b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570006a1 expref: 60 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710874.210419:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481400/0xcbad34b2815718b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570006a1 expref: 59 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710874.210428:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c51cca25000) 00010000:00010000:1.0:1790710874.210431:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790710874.210434:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c6481400, rc 0) 00000100:00100000:1.0:1790710874.210502:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4cf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+59:11481:x1877696158181376:12345-192.168.206.46@tcp:101:lfs.0 Request processed in 405us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710874.210510:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 167 00000100:00100000:3.0:1790710874.214559:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710874.214871:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158181760 00000100:00100000:0.0:1790710874.214885:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158181760 00000100:00100000:0.0:1790710874.215033:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 48 00000100:00100000:0.0:1790710874.215057:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4cf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+59:11481:x1877696158181760:12345-192.168.206.46@tcp:35:lfs.0 00000100:00100000:0.0:1790710874.215535:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4cf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+60:11481:x1877696158181760:12345-192.168.206.46@tcp:35:lfs.0 Request processed in 489us (989us total) trans 4294967457 rc 0/0 00000100:00100000:0.0:1790710874.215544:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 48 00000100:00100000:2.0:1790710874.218292:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710874.219239:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158181888 00000100:00100000:1.0:1790710874.219249:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158181888 00000100:00100000:1.0:1790710874.219487:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 14 00000100:00100000:1.0:1790710874.219496:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f400a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+60:11481:x1877696158181888:12345-192.168.206.46@tcp:103:lfs.0 00010000:00010000:1.0:1790710874.219512:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1790710874.219535:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c13fcc00/0xcbad34b281571847 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000685 expref: 60 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710874.219556:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b2815718a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700069a expref: 59 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710874.219568:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645e00/0xcbad34b281571752 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000646 expref: 58 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710874.219578:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c51c2c2e800) 00010000:00010000:1.0:1790710874.219588:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790710874.219646:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f400a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+57:11481:x1877696158181888:12345-192.168.206.46@tcp:103:lfs.0 Request processed in 150us (1371us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710874.219653:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 14 00000100:00100000:3.0:1790710874.222524:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710874.222852:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158182016 00000100:00100000:1.0:1790710874.222861:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158182016 00000100:00100000:1.0:1790710874.222915:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 168 00000100:00100000:1.0:1790710874.222925:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+57:11481:x1877696158182016:12345-192.168.206.46@tcp:58:lfs.0 00010000:00010000:1.0:1790710874.223038:0:8060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b2815718be lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710874.223056:0:8060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b2815718be lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710874.223067:0:8060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b2815718be lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790710874.223808:0:8060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:1.0:1790710874.224152:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+57:11481:x1877696158182016:12345-192.168.206.46@tcp:58:lfs.0 Request processed in 1201us (1609us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710874.224163:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 168 00000100:00100000:3.0:1790710874.262515:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710874.263497:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158182144 00000100:00100000:1.0:1790710874.263509:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158182144 00000100:00100000:1.0:1790710874.263563:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 169 00000100:00100000:1.0:1790710874.263573:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4cf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+57:11483:x1877696158182144:12345-192.168.206.46@tcp:101:lfs.0 00010000:00010000:1.0:1790710874.263594:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790710874.263615:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b2815718c5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b0570006a8 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710874.263678:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480400/0xcbad34b2815718cc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710874.263693:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480400/0xcbad34b2815718cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710874.263704:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480400/0xcbad34b2815718cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710874.263718:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b2815718d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710874.263726:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b2815718d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710874.263732:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b2815718d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710874.263837:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480200/0xcbad34b2815718da lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710874.263847:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480200/0xcbad34b2815718da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710874.263853:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480200/0xcbad34b2815718da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790710874.263887:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1790710874.263891:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790710874.263910:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480200/0xcbad34b2815718da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710874.263920:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480200/0xcbad34b2815718da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710874.263929:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480400/0xcbad34b2815718cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710874.263936:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480400/0xcbad34b2815718cc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710874.263942:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480400/0xcbad34b2815718cc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710874.263948:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c6480400 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1790710874.263953:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480400/0xcbad34b2815718cc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710874.263960:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480400/0xcbad34b2815718cc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710874.263990:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c51cca25000) 00010000:00010000:1.0:1790710874.263994:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790710874.263998:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480400/0xcbad34b2815718cc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710874.264005:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480400/0xcbad34b2815718cc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710874.264018:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b2815718d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710874.264024:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b2815718d3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710874.264030:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b2815718d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710874.264036:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c6480c00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1790710874.264038:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b2815718d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710874.264044:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b2815718d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710874.264051:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c51d8e33200) 00010000:00010000:1.0:1790710874.264053:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790710874.264056:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b2815718d3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710874.264060:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b2815718d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710874.264104:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b2815718c5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570006a8 expref: 59 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710874.264514:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480200/0xcbad34b2815718da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570006a8 expref: 58 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710874.264522:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c51d8e33f00) 00010000:00010000:1.0:1790710874.264524:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790710874.264526:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c6480200, rc 0) 00000100:00100000:1.0:1790710874.264585:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4cf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+58:11483:x1877696158182144:12345-192.168.206.46@tcp:101:lfs.0 Request processed in 1012us (2078us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710874.264593:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 169 00010000:00010000:2.0:1790710874.635420:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1790710874.948213:0:5867:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967457 is committed 00000004:00080000:3.0:1790710874.948681:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:3.0:1790710874.948705:0:5867:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c51f4ecf840 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1790710874.948710:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c51ff477500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c51f4ecf240 00000020:00080000:3.0:1790710874.948713:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c51ff477000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c51c7e20c00 00000020:00080000:3.0:1790710874.948786:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:3.0:1790710874.949005:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1790710874.949566:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51fa2cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1877696177054080:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1790710874.949635:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710874.949717:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177054080 00000100:00100000:3.0:1790710874.949724:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177054080 00000100:00100000:3.0:1790710874.949780:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1790710874.949791:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4cf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1877696177054080:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1790710874.949815:0:6698:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:3.0:1790710874.949846:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6abc1457, atime: 0x6abc1458, ctime: 0x6abc1457, blocks: 0xb 00010000:00010000:3.0:1790710874.949854:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b271cda/0xcbad34b2815718e1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710874.949870:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=352s v=(0 0) 00010000:00010000:3.0:1790710874.949874:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790710874.949880:0:6698:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b271cda/0xcbad34b2815718e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710874.949896:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b271cda/0xcbad34b2815718e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710874.949906:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b271cda/0xcbad34b2815718e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710874.949915:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b271cda/0xcbad34b2815718e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710874.949934:0:6698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1790710874.951820:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4cf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3310:x1877696177054080:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2027us (2179us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1790710874.951833:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1790710874.951872:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000100:00080000:3.0:1790710874.951873:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1790710874.951881:0:3310:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00010000:00010000:3.0:1790710874.951891:0:8509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790710874.951900:0:8509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b271cda/0xcbad34b2815718e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710874.951904:0:3310:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9c51fa2cf800 x1877696177054080/t4294967307(4294967307) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1790710890 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1790710874.951924:0:8509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c8046800 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:3.0:1790710874.951930:0:8509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b271cda/0xcbad34b2815718e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790710874.951930:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c51fa2cf800/2, rc 0, transno 4294967307 00000100:00100000:2.0:1790710874.951940:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51fa2cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1877696177054080:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1790710874.951946:0:8509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b271cda/0xcbad34b2815718e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710874.951967:0:8509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b271cda/0xcbad34b2815718e1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710874.951975:0:8509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b271cda/0xcbad34b2815718e1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710874.951995:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790710874.951997:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790710874.951999:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790710875.060556:0:12501:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790710875.060564:0:12501:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790710875.060694:0:12501:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:3.0:1790710875.060701:0:12501:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1790710875.207477:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790710875.207486:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790710875.207544:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:2.0:1790710875.207552:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790710875.207665:0:11676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4008000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11676:1877696177054208:192.168.206.46@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790710875.207811:0:11676:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f4013f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790710875.210477:0:11676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4008000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11676:1877696177054208:192.168.206.46@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1790710875.214416:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710875.214523:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158182272 00000100:00100000:2.0:1790710875.214533:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158182272 00000100:00100000:2.0:1790710875.214593:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 170 00000100:00100000:2.0:1790710875.214617:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51fa2cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+16:11495:x1877696158182272:12345-192.168.206.46@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1790710875.214651:0:5845:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1790710875.214756:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51fa2cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+16:11495:x1877696158182272:12345-192.168.206.46@tcp:53:lhsmtool_posix.0 Request processed in 139us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710875.214763:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 170 00000100:00100000:3.0:1790710875.221245:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710875.221310:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158182400 00000100:00100000:0.0:1790710875.221320:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158182400 00000100:00100000:0.0:1790710875.221381:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 171 00000100:00100000:0.0:1790710875.221390:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4cf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+16:11495:x1877696158182400:12345-192.168.206.46@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1790710875.221490:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b600/0xcbad34b2815718e8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710875.221515:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b600/0xcbad34b2815718e8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710875.221528:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b600/0xcbad34b2815718e8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710875.221597:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ac00/0xcbad34b2815718ef lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710875.221605:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ac00/0xcbad34b2815718ef lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710875.221611:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ac00/0xcbad34b2815718ef lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710875.221635:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243a400/0xcbad34b2815718f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710875.221643:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243a400/0xcbad34b2815718f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710875.221650:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243a400/0xcbad34b2815718f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790710875.221684:0:5846:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1790710875.221688:0:5846:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790710875.221700:0:5846:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243a400/0xcbad34b2815718f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710875.221710:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b600/0xcbad34b2815718e8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710875.221724:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b600/0xcbad34b2815718e8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710875.221731:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b600/0xcbad34b2815718e8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710875.221737:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c243b600 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1790710875.221741:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b600/0xcbad34b2815718e8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710875.221749:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b600/0xcbad34b2815718e8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710875.221761:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c51cca25300) 00010000:00010000:0.0:1790710875.221764:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790710875.221769:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b600/0xcbad34b2815718e8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710875.221774:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b600/0xcbad34b2815718e8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710875.221787:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ac00/0xcbad34b2815718ef lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710875.221793:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ac00/0xcbad34b2815718ef lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710875.221799:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ac00/0xcbad34b2815718ef lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710875.221805:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c243ac00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1790710875.221814:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ac00/0xcbad34b2815718ef lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710875.221820:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ac00/0xcbad34b2815718ef lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710875.221828:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9c51e4efb200) 00010000:00010000:0.0:1790710875.221830:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790710875.221834:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ac00/0xcbad34b2815718ef lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710875.221839:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ac00/0xcbad34b2815718ef lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710875.221853:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243a400/0xcbad34b2815718f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710875.221859:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243a400/0xcbad34b2815718f6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710875.221864:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243a400/0xcbad34b2815718f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710875.221868:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c243a400 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1790710875.221871:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243a400/0xcbad34b2815718f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710875.221876:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243a400/0xcbad34b2815718f6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710875.221883:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c51d8e33f00) 00010000:00010000:0.0:1790710875.221885:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790710875.221894:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243a400/0xcbad34b2815718f6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710875.221899:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243a400/0xcbad34b2815718f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710875.221976:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4cf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+16:11495:x1877696158182400:12345-192.168.206.46@tcp:34:lhsmtool_posix.0 Request processed in 586us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710875.221984:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 171 00000100:00100000:3.0:1790710875.226786:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710875.229412:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158182656 00000100:00100000:2.0:1790710875.229427:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158182656 00000100:00100000:2.0:1790710875.229497:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 172 00000100:00100000:2.0:1790710875.229507:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4cf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+16:11495:x1877696158182656:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790710875.229529:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790710875.229548:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9200/0xcbad34b2815718fd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b0570006af expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710875.229656:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8a00/0xcbad34b281571904 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710875.229671:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8a00/0xcbad34b281571904 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710875.229682:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8a00/0xcbad34b281571904 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790710875.229693:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1790710875.229885:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8a00/0xcbad34b281571904 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710875.229894:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8a00/0xcbad34b281571904 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710875.229901:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8a00/0xcbad34b281571904 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710875.229919:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51f43f8a00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1790710875.229923:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8a00/0xcbad34b281571904 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710875.229931:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8a00/0xcbad34b281571904 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710875.229943:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c51d8e33f00) 00010000:00010000:2.0:1790710875.229946:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790710875.229950:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8a00/0xcbad34b281571904 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710875.231338:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8a00/0xcbad34b281571904 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710875.231399:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9200/0xcbad34b2815718fd lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570006af expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710875.231414:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c51cca25300) 00010000:00010000:2.0:1790710875.231417:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790710875.231422:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9200/0xcbad34b2815718fd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570006af expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710875.231434:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51f43f9200, rc 0) 00000100:00100000:2.0:1790710875.231509:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4cf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+17:11495:x1877696158182656:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 Request processed in 2003us (4732us total) trans 4294967458 rc 301/301 00000100:00100000:2.0:1790710875.231518:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 172 00000100:00100000:2.0:1790710875.236024:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710875.236493:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158182784 00000100:00100000:0.0:1790710875.236503:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158182784 00000100:00100000:0.0:1790710875.236595:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 173 00000100:00100000:0.0:1790710875.236607:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4008000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+17:11495:x1877696158182784:12345-192.168.206.46@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1790710875.236642:0:5846:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1790710875.236747:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4008000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+17:11495:x1877696158182784:12345-192.168.206.46@tcp:53:lhsmtool_posix.0 Request processed in 143us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710875.236754:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 173 00000100:00100000:3.0:1790710875.241504:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710875.241585:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158183040 00000100:00100000:1.0:1790710875.241594:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158183040 00000100:00100000:1.0:1790710875.241652:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 174 00000100:00100000:1.0:1790710875.241661:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f498df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+17:11495:x1877696158183040:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790710875.241681:0:8060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790710875.241684:0:8060:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1790710875.241709:0:8060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481400/0xcbad34b2815718b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570006a1 expref: 17 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710875.241726:0:8060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c51cca25000) 00010000:00010000:1.0:1790710875.241731:0:8060:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790710875.241743:0:8060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571912 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b0570006b6 expref: -99 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790710875.242490:0:8060:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:1.0:1790710875.242725:0:8060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480400/0xcbad34b281571919 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710875.242740:0:8060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480400/0xcbad34b281571919 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710875.242750:0:8060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480400/0xcbad34b281571919 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710875.242803:0:8060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571912 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570006b6 expref: 19 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710875.242819:0:8060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480400/0xcbad34b281571919 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570006b6 expref: 18 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710875.242828:0:8060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c51d8e33200) 00010000:00010000:1.0:1790710875.242830:0:8060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790710875.242833:0:8060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c6480400, rc 0) 00000100:00100000:1.0:1790710875.242891:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f498df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+18:11495:x1877696158183040:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 Request processed in 1230us (1396us total) trans 4294967459 rc 0/0 00000100:00100000:1.0:1790710875.242899:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 174 00000100:00100000:1.0:1790710875.249236:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710875.249412:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158183296 00000100:00100000:3.0:1790710875.249423:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158183296 00000100:00100000:3.0:1790710875.249478:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 175 00000100:00100000:3.0:1790710875.249489:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff87ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+18:11495:x1877696158183296:12345-192.168.206.46@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790710875.249545:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790710875.249583:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480400/0xcbad34b281571919 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570006b6 expref: 18 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710875.249603:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c51d8e33200) 00010000:00010000:3.0:1790710875.249615:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790710875.249638:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b281571927 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710875.249654:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b281571927 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710875.249662:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b281571927 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710875.249676:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b28157192e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x24bad234 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710875.249683:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b28157192e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x24bad234 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710875.249689:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b28157192e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x24bad234 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710875.249907:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b281571927 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710875.249927:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b281571927 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710875.249934:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b281571927 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710875.249939:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c8046800 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1790710875.249943:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b281571927 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710875.249951:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b281571927 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710875.250223:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c51cca25000) 00010000:00010000:3.0:1790710875.250227:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790710875.250231:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b281571927 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710875.250238:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b281571927 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710875.251758:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b28157192e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x24bad234 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710875.251771:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b28157192e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x24bad234 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710875.251778:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b28157192e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x24bad234 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710875.251783:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c8046e00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1790710875.251801:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b28157192e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x24bad234 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710875.251809:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b28157192e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x24bad234 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710875.251822:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x24bad234 (ffff9c51c2c2e900) 00010000:00010000:3.0:1790710875.251824:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790710875.251828:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b28157192e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x24bad234 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710875.251833:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b28157192e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x24bad234 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710875.252198:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff87ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+17:11495:x1877696158183296:12345-192.168.206.46@tcp:36:lhsmtool_posix.0 Request processed in 2707us (2967us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790710875.252208:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 175 00000100:00100000:0.0:1790710875.257068:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710875.257252:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158183424 00000100:00100000:1.0:1790710875.257262:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158183424 00000100:00100000:1.0:1790710875.257315:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 176 00000100:00100000:1.0:1790710875.257325:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51fa2cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+17:11495:x1877696158183424:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790710875.257359:0:8060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790710875.257381:0:8060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481400/0xcbad34b281571935 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b0570006bd expref: -99 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710875.257416:0:8060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b28157193c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710875.257431:0:8060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b28157193c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710875.257453:0:8060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b28157193c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710875.257540:0:8060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481400/0xcbad34b281571935 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570006bd expref: 19 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710875.257557:0:8060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b28157193c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570006bd expref: 18 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710875.257564:0:8060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c51d8e33d00) 00010000:00010000:1.0:1790710875.257567:0:8060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790710875.257570:0:8060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c6481c00, rc 0) 00000100:00100000:1.0:1790710875.257675:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51fa2cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+18:11495:x1877696158183424:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 Request processed in 350us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710875.257683:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 176 00000100:00100000:1.0:1790710875.261589:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710875.261684:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158183680 00000100:00100000:0.0:1790710875.261692:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158183680 00000100:00100000:0.0:1790710875.261744:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 177 00000100:00100000:0.0:1790710875.261752:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff87f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+18:11495:x1877696158183680:12345-192.168.206.46@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790710875.261826:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ac00/0xcbad34b281571943 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710875.261843:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ac00/0xcbad34b281571943 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710875.261853:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ac00/0xcbad34b281571943 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790710875.262567:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:0.0:1790710875.262576:0:5846:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 352599448156ns, next at 353599446260ns, rc = 0 00000004:00010000:0.0:1790710875.262640:0:5846:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000ab7b9692 reply state 00000000992282dd transno 4294967460 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ac00/0xcbad34b281571943 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710875.262648:0:5846:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790710875.262735:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff87f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+20:11495:x1877696158183680:12345-192.168.206.46@tcp:36:lhsmtool_posix.0 Request processed in 983us (1152us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1790710875.262742:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 177 00000100:00100000:2.0:1790710875.269605:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710875.269703:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158183808 00000100:00100000:1.0:1790710875.269717:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158183808 00000100:00100000:1.0:1790710875.269789:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 178 00000100:00100000:1.0:1790710875.269812:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4009c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+20:11495:x1877696158183808:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790710875.269836:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790710875.269856:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481200/0xcbad34b28157194a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b0570006c4 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710875.269927:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481200/0xcbad34b28157194a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570006c4 expref: 21 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710875.269941:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481200/0xcbad34b28157194a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570006c4 expref: 21 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710875.269974:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c51d8e33d00) 00010000:00010000:1.0:1790710875.269977:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790710875.269981:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c6481200, rc 0) 00000100:00100000:1.0:1790710875.270038:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4009c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+21:11495:x1877696158183808:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 Request processed in 227us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710875.270045:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 178 00010000:00010000:0.0:1790710875.270507:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ac00/0xcbad34b281571943 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710875.270516:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ac00/0xcbad34b281571943 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710875.270523:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ac00/0xcbad34b281571943 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710875.270528:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c243ac00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1790710875.270533:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ac00/0xcbad34b281571943 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710875.270541:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ac00/0xcbad34b281571943 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710875.270552:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c51d8e33d00) 00010000:00010000:0.0:1790710875.270555:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790710875.270558:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ac00/0xcbad34b281571943 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710875.270576:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ac00/0xcbad34b281571943 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710875.274095:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710875.274391:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158183936 00000100:00100000:0.0:1790710875.274402:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158183936 00000100:00080000:3.0:1790710875.274482:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790710875.274489:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 51 00000100:00100000:0.0:1790710875.274503:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff87d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:2359:x1877696158183936:12345-192.168.206.46@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1790710875.274832:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff87d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+7:2359:x1877696158183936:12345-192.168.206.46@tcp:2:lhsmtool_posix.0 Request processed in 333us (746us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1790710875.274840:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 51 00000100:00100000:2.0:1790710875.277796:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710875.277937:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158184192 00000100:00100000:0.0:1790710875.277948:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158184192 00000100:00100000:0.0:1790710875.278021:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 49 00000100:00100000:0.0:1790710875.278031:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4008700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+20:11495:x1877696158184192:12345-192.168.206.46@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1790710875.278281:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4008700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+21:11495:x1877696158184192:12345-192.168.206.46@tcp:35:lhsmtool_posix.0 Request processed in 251us (494us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1790710875.278289:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 49 00000100:00100000:2.0:1790710875.280473:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710875.282930:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158184448 00000100:00100000:0.0:1790710875.282945:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158184448 00000100:00100000:0.0:1790710875.283036:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 179 00000100:00100000:0.0:1790710875.283047:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4009f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+21:11495:x1877696158184448:12345-192.168.206.46@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1790710875.283208:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4009f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+21:11495:x1877696158184448:12345-192.168.206.46@tcp:57:lhsmtool_posix.0 Request processed in 162us (2742us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710875.283217:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 179 00000100:00100000:1.0:1790710875.291955:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710875.292411:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158184576 00000100:00100000:3.0:1790710875.292421:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158184576 00000100:00100000:2.0:1790710875.293118:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 180 00000100:00100000:2.0:1790710875.293151:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff87d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+21:11495:x1877696158184576:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790710875.293170:0:8060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790710875.293189:0:8060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8a00/0xcbad34b281571951 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b0570006cb expref: -99 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710875.293276:0:8060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8c00/0xcbad34b281571958 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710875.293290:0:8060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8c00/0xcbad34b281571958 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710875.293300:0:8060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8c00/0xcbad34b281571958 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790710875.293335:0:8060:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790710875.293352:0:8060:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8c00/0xcbad34b281571958 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710875.293378:0:8060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8a00/0xcbad34b281571951 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570006cb expref: 23 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710875.293395:0:8060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8c00/0xcbad34b281571958 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570006cb expref: 22 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710875.293403:0:8060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c51d8e33d00) 00010000:00010000:2.0:1790710875.293418:0:8060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1790710875.293422:0:8060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51f43f8c00, rc 0) 00000100:00100000:2.0:1790710875.293486:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff87d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+22:11495:x1877696158184576:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 Request processed in 357us (1539us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710875.293493:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 180 00000100:00100000:1.0:1790710875.296653:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710875.299462:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158184704 00000100:00100000:3.0:1790710875.299477:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158184704 00000100:00100000:3.0:1790710875.299581:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 52 00000100:00100000:3.0:1790710875.299596:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff87c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+7:2356:x1877696158184704:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790710875.299614:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790710875.299635:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000001ad3754/0xcbad34b28157195f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b0570006d2 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790710875.299660:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abc145b, blocks: 0x1 00010000:00010000:3.0:1790710875.299680:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=352s v=(0 0) 00010000:00010000:3.0:1790710875.299696:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790710875.299705:0:6698:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001ad3754/0xcbad34b28157195f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570006d2 expref: 8 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710875.299725:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000001ad3754/0xcbad34b28157195f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570006d2 expref: 8 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710875.299749:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c8046e00, rc 0) 00000100:00100000:3.0:1790710875.299813:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff87c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+8:2356:x1877696158184704:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 Request processed in 221us (3171us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710875.299820:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 52 00000100:00100000:3.0:1790710875.305457:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710875.307844:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158184960 00000100:00100000:0.0:1790710875.307858:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158184960 00000100:00100000:0.0:1790710875.308168:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 181 00000100:00100000:0.0:1790710875.308181:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f498ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+22:11495:x1877696158184960:12345-192.168.206.46@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1790710875.308289:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f498ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+22:11495:x1877696158184960:12345-192.168.206.46@tcp:57:lhsmtool_posix.0 Request processed in 112us (2839us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710875.308298:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 181 00000100:00100000:1.0:1790710875.313740:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710875.313837:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158185088 00000100:00100000:0.0:1790710875.313846:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158185088 00000100:00100000:0.0:1790710875.313936:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 53 00000100:00100000:0.0:1790710875.313947:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff87ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+8:11495:x1877696158185088:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790710875.314198:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790710875.314218:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000683fecd5/0xcbad34b281571966 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b0570006d9 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710875.314248:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000001ad3754/0xcbad34b28157195f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570006d2 expref: 9 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710875.314258:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790710875.314262:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790710875.314267:0:6697:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000683fecd5/0xcbad34b281571966 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570006d9 expref: 9 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710875.314302:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000001ad3754/0xcbad34b28157195f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.46@tcp remote: 0x566877b0570006d2 expref: 9 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710875.314446:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000001ad3754/0xcbad34b28157195f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570006d2 expref: 9 pid: 6698 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710875.314460:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c652fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1877696177054336:192.168.206.46@tcp:104: 00000100:00100000:0.0:1790710875.314550:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f4045f00 going to sleep for 11 seconds 00000100:00100000:0.0:1790710875.316941:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c652fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1877696177054336:192.168.206.46@tcp:104: 00010000:00010000:0.0:1790710875.316988:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000683fecd5/0xcbad34b281571966 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.46@tcp remote: 0x566877b0570006d9 expref: 9 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710875.317123:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c243b600, rc 0) 00000100:00100000:1.0:1790710875.317517:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710875.317740:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158185216 00000100:00100000:3.0:1790710875.317747:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158185216 00010000:00010000:3.0:1790710875.317779:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000001ad3754/0xcbad34b28157195f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570006d2 expref: 10 pid: 6698 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710875.317816:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 66 00000100:00100000:3.0:1790710875.317824:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff87f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+10:2359:x1877696158185216:12345-192.168.206.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790710875.317837:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790710875.317858:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000001ad3754/0xcbad34b28157195f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570006d2 expref: 10 pid: 6698 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710875.317871:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000001ad3754/0xcbad34b28157195f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570006d2 expref: 10 pid: 6698 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710875.317910:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001ad3754/0xcbad34b28157195f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570006d2 expref: 10 pid: 6698 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710875.317926:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790710875.317930:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790710875.317936:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000683fecd5/0xcbad34b281571966 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.46@tcp remote: 0x566877b0570006d9 expref: 9 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710875.317945:0:5831:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000683fecd5/0xcbad34b281571966 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.46@tcp remote: 0x566877b0570006d9 expref: 9 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710875.317997:0:5831:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000683fecd5/0xcbad34b281571966 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.46@tcp remote: 0x566877b0570006d9 expref: 9 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710875.318019:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f498fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5831:1877696177054464:192.168.206.46@tcp:105: 00000100:00100000:3.0:1790710875.318095:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c8b99600 going to sleep for 11 seconds 00000100:00100000:2.0:1790710875.319315:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff87ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+9:11495:x1877696158185088:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 Request processed in 5357us (5569us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710875.319328:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 53 00000100:00100000:1.0:1790710875.322276:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710875.322410:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f498fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5831:1877696177054464:192.168.206.46@tcp:105: 00010000:00010000:3.0:1790710875.322430:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790710875.322478:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff87f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+8:2359:x1877696158185216:12345-192.168.206.46@tcp:103:ldlm_bl.0 Request processed in 4654us (4961us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710875.322488:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 66 00000100:00100000:2.0:1790710875.323730:0:6703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158185344 00000100:00100000:2.0:1790710875.323739:0:6703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158185344 00002000:00100000:2.0:1790710875.323781:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9c51ff87e680 x1877696158185344/t0(0) o4->0ec73bd1-726e-4dc0-8edd-807d3f973d65@192.168.206.46@tcp:376/0 lens 504/0 e 0 to 0 dl 1790710886 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790710875.323793:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c51ff87e680 with x1877696158185344 ext(0->8) 00002000:00010000:2.0:1790710875.323798:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c51ff87e680 00000100:00100000:2.0:1790710875.323862:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 4 00000100:00100000:2.0:1790710875.323871:0:6703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff87e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+8:2359:x1877696158185344:12345-192.168.206.46@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1790710875.324321:0:6703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff87e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+10:2359:x1877696158185344:12345-192.168.206.46@tcp:4:lhsmtool_posix.0 Request processed in 449us (2051us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1790710875.324340:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 4 00002000:00100000:2.0:1790710875.324346:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9c51ff87e680 x1877696158185344/t4294967314(0) o4->0ec73bd1-726e-4dc0-8edd-807d3f973d65@192.168.206.46@tcp:376/0 lens 504/448 e 0 to 0 dl 1790710886 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790710875.324355:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c51ff87e680 with x1877696158185344 ext(0->8) 00002000:00010000:2.0:1790710875.324359:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c51ff87e680 00000100:00100000:3.0:1790710875.327589:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710875.327672:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158185472 00000100:00100000:1.0:1790710875.327681:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158185472 00000100:00100000:1.0:1790710875.327743:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 182 00000100:00100000:1.0:1790710875.327752:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f498fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+22:11495:x1877696158185472:12345-192.168.206.46@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1790710875.372019:0:5867:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967461 is committed 00000004:00080000:3.0:1790710875.372036:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:3.0:1790710875.372122:0:5867:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:3.0:1790710875.372175:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:3.0:1790710875.372184:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1790710875.372411:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790710875.372430:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4008e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1877696177054592:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1790710875.372508:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710875.372559:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f498fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+18:11495:x1877696158185472:12345-192.168.206.46@tcp:44:lhsmtool_posix.0 Request processed in 44805us (44975us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710875.372570:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 182 00000100:00100000:2.0:1790710875.372579:0:6696:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177054592 00000100:00100000:2.0:1790710875.372588:0:6696:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177054592 00000100:00100000:2.0:1790710875.372652:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1790710875.372661:0:6696:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c652fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1877696177054592:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1790710875.372803:0:6696:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1790710875.372806:0:6696:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1790710875 00002000:00010000:2.0:1790710875.372809:0:6696:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1790710875.372811:0:6696:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1790710875 -> 1790710875 00002000:00010000:2.0:1790710875.372813:0:6696:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00080000:3.0:1790710875.373739:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790710875.375312:0:6696:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c652fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1877696177054592:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2646us (2796us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1790710875.375324:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:0.0:1790710875.375586:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c51f4008e00/2, rc 0, transno 4294967315 00000100:00100000:0.0:1790710875.375594:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4008e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1877696177054592:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1790710875.376405:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710875.376603:0:12058:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158185600 00000100:00100000:1.0:1790710875.376611:0:12058:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158185600 00000100:00100000:1.0:1790710875.376661:0:12058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 55 00000100:00100000:1.0:1790710875.376670:0:12058:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f498d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+10:2358:x1877696158185600:12345-192.168.206.46@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1790710875.424278:0:7643:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:2.0:1790710875.424293:0:7643:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000001:00080000:2.0:1790710875.424298:0:7643:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000100:00100000:0.0:1790710875.425410:0:12058:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f498d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+7:2358:x1877696158185600:12345-192.168.206.46@tcp:16:lhsmtool_posix.0 Request processed in 48734us (49002us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710875.425421:0:12058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 55 00000100:00100000:1.0:1790710875.429683:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710875.429862:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158185856 00000100:00100000:2.0:1790710875.429871:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158185856 00000100:00100000:2.0:1790710875.429983:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 183 00000100:00100000:2.0:1790710875.429994:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff87f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+18:11495:x1877696158185856:12345-192.168.206.46@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790710875.430046:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790710875.430072:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8c00/0xcbad34b281571958 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570006cb expref: 18 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710875.430089:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c51d8e33d00) 00010000:00010000:2.0:1790710875.430094:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790710875.430161:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8a00/0xcbad34b28157196d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710875.430436:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8a00/0xcbad34b28157196d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710875.430466:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8a00/0xcbad34b28157196d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790710875.430720:0:5847:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000012400605 reply state 00000000b711cfa8 transno 4294967462 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8a00/0xcbad34b28157196d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710875.430730:0:5847:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790710875.430869:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff87f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+19:11495:x1877696158185856:12345-192.168.206.46@tcp:36:lhsmtool_posix.0 Request processed in 875us (1192us total) trans 4294967462 rc 0/0 00000100:00100000:2.0:1790710875.430877:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 183 00010000:00010000:0.0:1790710875.433767:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8a00/0xcbad34b28157196d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710875.433784:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8a00/0xcbad34b28157196d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710875.433806:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8a00/0xcbad34b28157196d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710875.433812:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51f43f8a00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1790710875.433817:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8a00/0xcbad34b28157196d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710875.433824:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8a00/0xcbad34b28157196d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710875.433838:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c51d8e33d00) 00010000:00010000:0.0:1790710875.433841:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790710875.433846:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8a00/0xcbad34b28157196d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710875.433852:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8a00/0xcbad34b28157196d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710875.434644:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710875.435056:0:6696:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158185984 00000100:00100000:2.0:1790710875.435064:0:6696:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158185984 00000100:00100000:2.0:1790710875.435514:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 56 00000100:00100000:2.0:1790710875.435529:0:6696:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff87e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+7:2358:x1877696158185984:12345-192.168.206.46@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1790710875.436114:0:6696:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1790710875.436118:0:6696:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1790710875 -> 1790710873 00002000:00010000:2.0:1790710875.436120:0:6696:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1790710872 00002000:00010000:2.0:1790710875.436122:0:6696:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1790710875 -> 1790710873 00002000:00010000:2.0:1790710875.436124:0:6696:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1790710875.436579:0:6696:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff87e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+8:2358:x1877696158185984:12345-192.168.206.46@tcp:2:lhsmtool_posix.0 Request processed in 1054us (1939us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1790710875.436588:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 56 00000100:00100000:3.0:1790710875.442318:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710875.442621:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158186240 00000100:00100000:2.0:1790710875.442630:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158186240 00000100:00100000:2.0:1790710875.442750:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 184 00000100:00100000:2.0:1790710875.442761:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f498ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+18:11495:x1877696158186240:12345-192.168.206.46@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1790710875.442848:0:8060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8c00/0xcbad34b281571974 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710875.442865:0:8060:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b28157193c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570006bd expref: 18 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710875.442874:0:8060:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8c00/0xcbad34b281571974 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710875.442904:0:8060:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b28157193c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.46@tcp remote: 0x566877b0570006bd expref: 18 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710875.442917:0:8060:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b28157193c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570006bd expref: 18 pid: 8060 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710875.442931:0:8060:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f400bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8060:1877696177054720:192.168.206.46@tcp:104: 00000100:00100000:2.0:1790710875.443019:0:8060:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f4013900 going to sleep for 11 seconds 00000100:00100000:2.0:1790710875.447316:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710875.447421:0:8060:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f400bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8060:1877696177054720:192.168.206.46@tcp:104: 00010000:00010000:1.0:1790710875.447460:0:8060:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8c00/0xcbad34b281571974 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710875.448761:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158186368 00000100:00100000:0.0:1790710875.448770:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158186368 00010000:00010000:0.0:1790710875.448808:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b28157193c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570006bd expref: 19 pid: 8060 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710875.449080:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 67 00000100:00100000:0.0:1790710875.449091:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4008a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+19:2358:x1877696158186368:12345-192.168.206.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790710875.449117:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790710875.449124:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b28157193c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570006bd expref: 19 pid: 8060 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710875.449243:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b28157193c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570006bd expref: 19 pid: 8060 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710875.449265:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b28157193c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570006bd expref: 19 pid: 8060 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710875.449386:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c51d8e33d00) 00010000:00010000:0.0:1790710875.449393:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8c00/0xcbad34b281571974 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710875.449403:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8c00/0xcbad34b281571974 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710875.449411:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8c00/0xcbad34b281571974 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710875.449431:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790710875.449519:0:8060:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8c00/0xcbad34b281571974 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710875.449539:0:8060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8c00/0xcbad34b281571974 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710875.449545:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4008a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+18:2358:x1877696158186368:12345-192.168.206.46@tcp:103:ldlm_bl.0 Request processed in 453us (2234us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710875.449556:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 67 00010000:00010000:1.0:1790710875.449572:0:8060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8c00/0xcbad34b281571974 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710875.449580:0:8060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8c00/0xcbad34b281571974 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710875.449587:0:8060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8c00/0xcbad34b281571974 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710875.449593:0:8060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51f43f8c00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1790710875.449605:0:8060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8c00/0xcbad34b281571974 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710875.449614:0:8060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8c00/0xcbad34b281571974 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710875.449623:0:8060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c51d8e33d00) 00010000:00010000:1.0:1790710875.449625:0:8060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1790710875.449628:0:8060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8c00/0xcbad34b281571974 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710875.449634:0:8060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8c00/0xcbad34b281571974 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710875.449685:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f498ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+17:11495:x1877696158186240:12345-192.168.206.46@tcp:55:lhsmtool_posix.0 Request processed in 6925us (7374us total) trans 0 rc -22/-22 00000100:00100000:1.0:1790710875.449693:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 184 00000100:00100000:3.0:1790710875.455750:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710875.457304:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158186496 00000100:00100000:2.0:1790710875.457317:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158186496 00000100:00100000:2.0:1790710875.457382:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 57 00000100:00100000:2.0:1790710875.457391:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f498f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+8:2356:x1877696158186496:12345-192.168.206.46@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1790710875.457430:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000363dfc64/0xcbad34b28157197b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710875.457449:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000683fecd5/0xcbad34b281571966 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.46@tcp remote: 0x566877b0570006d9 expref: 8 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710875.457475:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790710875.457479:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790710875.457483:0:6697:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000363dfc64/0xcbad34b28157197b lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710875.457515:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000683fecd5/0xcbad34b281571966 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.46@tcp remote: 0x566877b0570006d9 expref: 8 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710875.457530:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000683fecd5/0xcbad34b281571966 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.46@tcp remote: 0x566877b0570006d9 expref: 8 pid: 6697 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710875.457544:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f400b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1877696177054848:192.168.206.46@tcp:104: 00000100:00100000:2.0:1790710875.457636:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f4013480 going to sleep for 11 seconds 00000100:00100000:3.0:1790710875.461892:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f400b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1877696177054848:192.168.206.46@tcp:104: 00010000:00010000:3.0:1790710875.461924:0:6697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000363dfc64/0xcbad34b28157197b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710875.463380:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710875.463688:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158186624 00000100:00100000:1.0:1790710875.463697:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158186624 00010000:00010000:1.0:1790710875.463735:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000683fecd5/0xcbad34b281571966 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.46@tcp remote: 0x566877b0570006d9 expref: 9 pid: 6697 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710875.463770:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 68 00000100:00100000:1.0:1790710875.463785:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8e5c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+9:2359:x1877696158186624:12345-192.168.206.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790710875.463801:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790710875.463821:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000683fecd5/0xcbad34b281571966 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.46@tcp remote: 0x566877b0570006d9 expref: 9 pid: 6697 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710875.463834:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000683fecd5/0xcbad34b281571966 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.46@tcp remote: 0x566877b0570006d9 expref: 9 pid: 6697 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710875.463865:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000683fecd5/0xcbad34b281571966 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.46@tcp remote: 0x566877b0570006d9 expref: 9 pid: 6697 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710875.463881:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790710875.463885:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790710875.463891:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000363dfc64/0xcbad34b28157197b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710875.463901:0:5830:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000363dfc64/0xcbad34b28157197b lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710875.463933:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790710875.464036:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8e5c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+8:2359:x1877696158186624:12345-192.168.206.46@tcp:103:ldlm_bl.0 Request processed in 256us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710875.464044:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 68 00010000:00010000:2.0:1790710875.464722:0:6697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000363dfc64/0xcbad34b28157197b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710875.464734:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000363dfc64/0xcbad34b28157197b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710875.464763:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000363dfc64/0xcbad34b28157197b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710875.464771:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000363dfc64/0xcbad34b28157197b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710875.464794:0:6697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000363dfc64/0xcbad34b28157197b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710875.464802:0:6697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51f43f8800 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:2.0:1790710875.464806:0:6697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000363dfc64/0xcbad34b28157197b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710875.464815:0:6697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000363dfc64/0xcbad34b28157197b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710875.464830:0:6697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000363dfc64/0xcbad34b28157197b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710875.464838:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000363dfc64/0xcbad34b28157197b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710875.464902:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f498f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+7:2356:x1877696158186496:12345-192.168.206.46@tcp:1:lhsmtool_posix.0 Request processed in 7511us (9161us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710875.464911:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 57 00000100:00100000:3.0:1790710875.471700:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710875.471908:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158186880 00000100:00100000:0.0:1790710875.471917:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158186880 00000100:00100000:0.0:1790710875.472001:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 185 00000100:00100000:0.0:1790710875.472012:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f498d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+17:11495:x1877696158186880:12345-192.168.206.46@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1790710875.472086:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243aa00/0xcbad34b281571982 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710875.472113:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243aa00/0xcbad34b281571982 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710875.472169:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243aa00/0xcbad34b281571982 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710875.472548:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481400/0xcbad34b281571989 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710875.472560:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481200/0xcbad34b28157194a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570006c4 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710875.472568:0:5846:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481400/0xcbad34b281571989 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710875.472601:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481200/0xcbad34b28157194a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.46@tcp remote: 0x566877b0570006c4 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710875.472628:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481200/0xcbad34b28157194a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570006c4 expref: 18 pid: 5845 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710875.472644:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51ff87f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1877696177054976:192.168.206.46@tcp:104: 00000100:00100000:1.0:1790710875.472735:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51e4d50000 going to sleep for 11 seconds 00000100:00100000:2.0:1790710875.475697:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51ff87f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1877696177054976:192.168.206.46@tcp:104: 00010000:00010000:2.0:1790710875.475724:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481400/0xcbad34b281571989 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710875.476770:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710875.477389:0:8449:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158187008 00000100:00100000:0.0:1790710875.477397:0:8449:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158187008 00010000:00010000:0.0:1790710875.477435:0:8449:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481200/0xcbad34b28157194a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570006c4 expref: 19 pid: 5845 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710875.477476:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 69 00000100:00100000:0.0:1790710875.477485:0:8449:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f498d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+19:2358:x1877696158187008:12345-192.168.206.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790710875.477500:0:8449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790710875.477506:0:8449:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481200/0xcbad34b28157194a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570006c4 expref: 19 pid: 5845 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710875.477517:0:8449:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481200/0xcbad34b28157194a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570006c4 expref: 19 pid: 5845 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710875.477539:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481200/0xcbad34b28157194a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570006c4 expref: 19 pid: 5845 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710875.477554:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c51d8e33d00) 00010000:00010000:0.0:1790710875.477559:0:8449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481400/0xcbad34b281571989 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710875.477568:0:8449:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481400/0xcbad34b281571989 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710875.477576:0:8449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481400/0xcbad34b281571989 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710875.477618:0:8449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790710875.477658:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481400/0xcbad34b281571989 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710875.477672:0:8449:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f498d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+18:2358:x1877696158187008:12345-192.168.206.46@tcp:103:ldlm_bl.0 Request processed in 188us (905us total) trans 0 rc 0/0 00010000:00010000:2.0:1790710875.477677:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481400/0xcbad34b281571989 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710875.477679:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 69 00000001:00080000:2.0:1790710875.477841:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:2.0:1790710875.478292:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:2.0:1790710875.478342:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:2.0:1790710875.478422:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f400b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5846:1877696177055104:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1790710875.478474:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710875.478510:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f4045f00 going to sleep for 11 seconds 00000100:00100000:3.0:1790710875.479208:0:5851:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177055104 00000100:00100000:3.0:1790710875.479215:0:5851:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177055104 00000100:00100000:3.0:1790710875.479281:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790710875.479290:0:5851:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4009180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5846:x1877696177055104:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1790710875.479378:0:5851:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4009180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5846:x1877696177055104:12345-0@lo:1000:mdt00_001.0 Request processed in 89us (903us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710875.479385:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790710875.479834:0:5846:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:2.0:1790710875.479840:0:5846:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c51f4008e00, transno 4294967315 00000100:00100000:2.0:1790710875.479861:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f400b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5846:1877696177055104:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1790710875.480388:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:2.0:1790710875.480461:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f400b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5846:1877696177055232:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1790710875.480501:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710875.480592:0:5851:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177055232 00000100:00100000:0.0:1790710875.480598:0:5851:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177055232 00000100:00100000:0.0:1790710875.480633:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790710875.480641:0:5851:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f400a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5846:x1877696177055232:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1790710875.480783:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f01e6a80 going to sleep for 11 seconds 00000100:00100000:0.0:1790710875.480815:0:5851:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f400a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5846:x1877696177055232:12345-0@lo:1000:mdt00_001.0 Request processed in 174us (312us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1790710875.480980:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f400b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5846:1877696177055232:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1790710875.481010:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481400/0xcbad34b281571989 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710875.481020:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481400/0xcbad34b281571989 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710875.481028:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481400/0xcbad34b281571989 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710875.481034:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c6481400 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1790710875.481039:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481400/0xcbad34b281571989 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710875.481052:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481400/0xcbad34b281571989 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710875.481067:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c51d8e33d00) 00010000:00010000:2.0:1790710875.481070:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790710875.481075:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481400/0xcbad34b281571989 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710875.481081:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481400/0xcbad34b281571989 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710875.481400:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1790710875.481455:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b2815718be lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710875.481463:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b2815718be lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710875.481469:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b2815718be lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710875.481474:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c6480e00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1790710875.481477:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b2815718be lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710875.481483:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b2815718be lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710875.481491:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c51d8e33f00) 00010000:00010000:2.0:1790710875.481494:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790710875.481497:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b2815718be lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710875.481511:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b2815718be lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710875.481643:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8800/0xcbad34b281571990 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710875.481656:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480200/0xcbad34b2815718da lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570006a8 expref: 21 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710875.481665:0:5846:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8800/0xcbad34b281571990 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710875.481692:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480200/0xcbad34b2815718da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.46@tcp remote: 0x566877b0570006a8 expref: 21 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710875.481706:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480200/0xcbad34b2815718da lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570006a8 expref: 21 pid: 5847 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710875.481716:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4008a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1877696177055360:192.168.206.46@tcp:104: 00000100:00100000:2.0:1790710875.481780:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f01e6a80 going to sleep for 11 seconds 00000100:00100000:3.0:1790710875.490869:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710875.491198:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4008a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1877696177055360:192.168.206.46@tcp:104: 00010000:00010000:2.0:1790710875.491229:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8800/0xcbad34b281571990 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710875.491272:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158187136 00000100:00100000:1.0:1790710875.491279:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158187136 00010000:00010000:1.0:1790710875.491315:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480200/0xcbad34b2815718da lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570006a8 expref: 22 pid: 5847 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710875.491360:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 70 00000100:00100000:1.0:1790710875.491369:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f498c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+22:2359:x1877696158187136:12345-192.168.206.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790710875.491383:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790710875.491390:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480200/0xcbad34b2815718da lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570006a8 expref: 22 pid: 5847 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710875.491401:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480200/0xcbad34b2815718da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570006a8 expref: 22 pid: 5847 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710875.491421:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480200/0xcbad34b2815718da lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570006a8 expref: 22 pid: 5847 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710875.491435:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c51d8e33f00) 00010000:00010000:1.0:1790710875.491440:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8800/0xcbad34b281571990 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710875.491468:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8800/0xcbad34b281571990 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710875.491476:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8800/0xcbad34b281571990 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710875.491505:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790710875.491554:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f498c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+21:2359:x1877696158187136:12345-192.168.206.46@tcp:103:ldlm_bl.0 Request processed in 185us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710875.491562:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 70 00010000:00010000:2.0:1790710875.492041:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8800/0xcbad34b281571990 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710875.492051:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8800/0xcbad34b281571990 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710875.492069:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8800/0xcbad34b281571990 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710875.492076:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8800/0xcbad34b281571990 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710875.492083:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8800/0xcbad34b281571990 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710875.492089:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51f43f8800 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1790710875.492093:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8800/0xcbad34b281571990 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710875.492100:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8800/0xcbad34b281571990 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710875.492120:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c51d8e33f00) 00010000:00010000:2.0:1790710875.492123:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790710875.492159:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8800/0xcbad34b281571990 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710875.492166:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8800/0xcbad34b281571990 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710875.492176:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243aa00/0xcbad34b281571982 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710875.492182:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243aa00/0xcbad34b281571982 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710875.492194:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243aa00/0xcbad34b281571982 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710875.492205:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c243aa00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1790710875.492209:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243aa00/0xcbad34b281571982 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710875.492215:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243aa00/0xcbad34b281571982 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710875.492224:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c51d8e33f00) 00010000:00010000:2.0:1790710875.492226:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790710875.492230:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243aa00/0xcbad34b281571982 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710875.492235:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243aa00/0xcbad34b281571982 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710875.495920:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f498d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+20:11495:x1877696158186880:12345-192.168.206.46@tcp:57:lhsmtool_posix.0 Request processed in 23900us (24217us total) trans 4294967467 rc 0/0 00000100:00100000:2.0:1790710875.495935:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 185 00000020:00080000:2.0:1790710875.495942:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1790710875.497867:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790710875.497876:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790710875.499692:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1790710875.499707:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790710875.506756:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710875.506905:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158187392 00000100:00100000:0.0:1790710875.506915:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158187392 00000100:00100000:0.0:1790710875.506975:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 50 00000100:00100000:0.0:1790710875.506985:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d6263450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+20:11495:x1877696158187392:12345-192.168.206.46@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1790710875.508639:0:5849:0:(mdd_object.c:4180:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1790710875.510226:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967468 00010000:00010000:1.0:1790710875.510700:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480200/0xcbad34b281571997 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710875.510719:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480200/0xcbad34b281571997 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710875.510807:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480200/0xcbad34b281571997 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710875.510817:0:5849:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480200/0xcbad34b281571997 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710875.510824:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480200/0xcbad34b281571997 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710875.510831:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480200/0xcbad34b281571997 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710875.510913:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1790710875.511046:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d6263450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+22:11495:x1877696158187392:12345-192.168.206.46@tcp:35:lhsmtool_posix.0 Request processed in 4058us (4294us total) trans 4294967469 rc 0/0 00000100:00100000:1.0:1790710875.511068:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 50 00000020:00080000:1.0:1790710875.511074:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1790710875.514703:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790710875.514839:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480200/0xcbad34b281571997 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710875.514850:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c6480200 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:3.0:1790710875.514854:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480200/0xcbad34b281571997 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710875.514863:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480200/0xcbad34b281571997 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710875.514879:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c51d8e33700) 00010000:00010000:3.0:1790710875.514882:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1790710875.514888:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480200/0xcbad34b281571997 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710875.514894:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480200/0xcbad34b281571997 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710875.515034:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710875.515037:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710875.515038:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710875.655395:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790710875.911353:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f498ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d27fc27-b651-404a-bd8c-b798806fb18a:3312:1877696177055488:0@lo:400:kworker.0 00000100:00100000:0.0:1790710875.911453:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710875.911567:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177055488 00000100:00100000:1.0:1790710875.911577:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177055488 00000100:00100000:1.0:1790710875.911631:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1790710875.911641:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8ff8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+19:3312:x1877696177055488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790710875.912096:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f498f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177055872:0@lo:400:kworker.0 00000100:00100000:2.0:1790710875.912437:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710875.912488:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f498e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1877696177055744:0@lo:400:kworker.0 00000100:00100000:2.0:1790710875.912595:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710875.912618:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790710875.912638:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f498f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877696177055616:0@lo:400:kworker.0 00000100:00100000:2.0:1790710875.912663:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710875.912692:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177055744 00000100:00100000:2.0:1790710875.912697:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177055744 00000100:00100000:2.0:1790710875.912742:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177055616 00000100:00100000:2.0:1790710875.912745:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177055616 00000100:00100000:2.0:1790710875.912767:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1790710875.912774:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f400b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1877696177055744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790710875.912819:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f400b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1877696177055744:12345-0@lo:400:kworker.0 Request processed in 44us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710875.912826:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1790710875.912843:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1790710875.917159:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8ff8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+19:3312:x1877696177055488:12345-0@lo:400:kworker.0 Request processed in 5509us (5695us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710875.917175:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1790710875.917231:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f400bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1877696177055616:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1790710875.917281:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790710875.917323:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f400bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1877696177055616:12345-0@lo:400:kworker.0 Request processed in 4474us (4659us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710875.917341:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1790710875.917370:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177055872 00000100:00100000:1.0:1790710875.917378:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177055872 00000100:00100000:2.0:1790710875.917402:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f498f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877696177055616:0@lo:400:kworker.0 00000100:00100000:2.0:1790710875.917417:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f498e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1877696177055744:0@lo:400:kworker.0 00000100:00100000:1.0:1790710875.917425:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1790710875.917435:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4008a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3311:x1877696177055872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790710875.917476:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4008a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3311:x1877696177055872:12345-0@lo:400:kworker.0 Request processed in 43us (5040us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710875.917484:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1790710875.917522:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f498f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177055872:0@lo:400:kworker.0 00000100:00100000:0.0:1790710875.917715:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f498ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d27fc27-b651-404a-bd8c-b798806fb18a:3312:1877696177055488:0@lo:400:kworker.0 00000100:00100000:2.0:1790710875.917983:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f498ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1877696177056128:0@lo:400:kworker.0 00000100:00100000:0.0:1790710875.918008:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f498e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1877696177056000:0@lo:400:kworker.0 00000100:00100000:2.0:1790710875.918024:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710875.918048:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710875.918092:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177056000 00000100:00100000:0.0:1790710875.918096:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177056000 00000100:00100000:0.0:1790710875.918529:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1790710875.918538:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f978df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1877696177056000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790710875.918597:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f978df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1877696177056000:12345-0@lo:400:kworker.0 Request processed in 60us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710875.918605:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1790710875.918649:0:12058:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177056128 00000100:00100000:3.0:1790710875.918655:0:12058:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177056128 00000100:00080000:1.0:1790710875.918661:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790710875.918690:0:12058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1790710875.918697:0:12058:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4008700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3309:x1877696177056128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790710875.918709:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f498e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1877696177056000:0@lo:400:kworker.0 00000100:00100000:3.0:1790710875.918756:0:12058:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4008700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3309:x1877696177056128:12345-0@lo:400:kworker.0 Request processed in 58us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710875.918764:0:12058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1790710875.918781:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f498ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1877696177056128:0@lo:400:kworker.0 00000100:00100000:3.0:1790710876.424572:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4008e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1877696177056256:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790710876.424671:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710876.429757:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177056256 00000100:00100000:0.0:1790710876.429778:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177056256 00000100:00100000:0.0:1790710876.429839:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1790710876.429851:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f498c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1877696177056256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790710876.429885:0:6700:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:0.0:1790710876.432977:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f498c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1877696177056256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3105us (8283us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710876.432997:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1790710876.433525:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4008e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1877696177056256:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1790710876.679282:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790710876.809474:0:12554:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790710876.809484:0:12554:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790710876.809531:0:12554:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:2.0:1790710876.809538:0:12554:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790710876.934969:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710876.935402:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158187648 00000100:00100000:0.0:1790710876.935412:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158187648 00000100:00100000:0.0:1790710876.935469:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 186 00000100:00100000:0.0:1790710876.935479:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff87ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+22:11512:x1877696158187648:12345-192.168.206.46@tcp:101:lfs.0 00010000:00010000:0.0:1790710876.935502:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790710876.935522:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243a400/0xcbad34b28157199e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b0570006e0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710876.935615:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b200/0xcbad34b2815719a5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710876.935631:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b200/0xcbad34b2815719a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710876.935642:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b200/0xcbad34b2815719a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790710876.935667:0:5846:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1790710876.935783:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243a400/0xcbad34b28157199e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570006e0 expref: 25 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710876.935800:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b200/0xcbad34b2815719a5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570006e0 expref: 24 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710876.935808:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c51cca25000) 00010000:00010000:0.0:1790710876.935811:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790710876.935815:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c243b200, rc 0) 00000100:00100000:0.0:1790710876.935867:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff87ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+24:11512:x1877696158187648:12345-192.168.206.46@tcp:101:lfs.0 Request processed in 389us (905us total) trans 4294967470 rc 0/0 00000100:00100000:0.0:1790710876.935874:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 186 00000100:00080000:1.0:1790710876.936377:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790710876.941153:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790710876.941176:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4008e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1877696177056384:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790710876.941252:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710876.941313:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177056384 00000100:00100000:2.0:1790710876.941319:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177056384 00000100:00100000:2.0:1790710876.941371:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1790710876.941381:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1877696177056384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790710876.941415:0:6699:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790710876.941457:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1877696177056384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710876.941464:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1790710876.941511:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4008e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1877696177056384:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1790710876.941531:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790710876.943843:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710876.945647:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158187776 00000100:00100000:2.0:1790710876.945661:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158187776 00000100:00100000:2.0:1790710876.945794:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 187 00000100:00100000:2.0:1790710876.945804:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff87c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+24:11512:x1877696158187776:12345-192.168.206.46@tcp:34:lfs.0 00010000:00010000:2.0:1790710876.945877:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8800/0xcbad34b2815719b3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710876.945895:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8800/0xcbad34b2815719b3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710876.945906:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8800/0xcbad34b2815719b3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710876.945921:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8c00/0xcbad34b2815719ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710876.945940:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8c00/0xcbad34b2815719ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710876.945947:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8c00/0xcbad34b2815719ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710876.946250:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8200/0xcbad34b2815719c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710876.946259:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8200/0xcbad34b2815719c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710876.946266:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8200/0xcbad34b2815719c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790710876.946303:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8200/0xcbad34b2815719c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710876.946315:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8800/0xcbad34b2815719b3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710876.946322:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8800/0xcbad34b2815719b3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710876.946328:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8800/0xcbad34b2815719b3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710876.946334:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51f43f8800 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1790710876.946338:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8800/0xcbad34b2815719b3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710876.946346:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8800/0xcbad34b2815719b3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710876.946365:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c51cca25000) 00010000:00010000:2.0:1790710876.946368:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790710876.946373:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8800/0xcbad34b2815719b3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710876.946379:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8800/0xcbad34b2815719b3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710876.946390:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8c00/0xcbad34b2815719ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710876.946397:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8c00/0xcbad34b2815719ba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710876.946402:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8c00/0xcbad34b2815719ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710876.946407:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51f43f8c00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1790710876.946410:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8c00/0xcbad34b2815719ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710876.946416:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8c00/0xcbad34b2815719ba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710876.946423:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c51cca25100) 00010000:00010000:2.0:1790710876.946426:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790710876.946429:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8c00/0xcbad34b2815719ba lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710876.946434:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8c00/0xcbad34b2815719ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710876.946459:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8200/0xcbad34b2815719c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710876.946465:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8200/0xcbad34b2815719c1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710876.946471:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8200/0xcbad34b2815719c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710876.946476:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51f43f8200 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1790710876.946479:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8200/0xcbad34b2815719c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710876.946486:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8200/0xcbad34b2815719c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710876.946494:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c51cca25700) 00010000:00010000:2.0:1790710876.946496:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790710876.946499:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8200/0xcbad34b2815719c1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710876.946504:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8200/0xcbad34b2815719c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710876.946577:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff87c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+24:11512:x1877696158187776:12345-192.168.206.46@tcp:34:lfs.0 Request processed in 773us (2741us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710876.946586:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 187 00000100:00100000:0.0:1790710876.993427:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710876.993543:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158188032 00000100:00100000:1.0:1790710876.993559:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158188032 00000100:00100000:1.0:1790710876.993673:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 188 00000100:00100000:1.0:1790710876.993697:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f3e74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+24:11515:x1877696158188032:12345-192.168.206.46@tcp:101:lfs.0 00010000:00010000:1.0:1790710876.993717:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790710876.993736:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481200/0xcbad34b2815719c8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b0570006e7 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710876.993809:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480400/0xcbad34b2815719cf lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710876.993823:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480400/0xcbad34b2815719cf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710876.993833:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480400/0xcbad34b2815719cf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710876.993848:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b2815719d6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710876.993855:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b2815719d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710876.993860:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b2815719d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710876.994179:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b2815719dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710876.994188:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b2815719dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710876.994195:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b2815719dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790710876.994215:0:5846:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1790710876.994309:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480400/0xcbad34b2815719cf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710876.994317:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480400/0xcbad34b2815719cf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710876.994324:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480400/0xcbad34b2815719cf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710876.994329:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c6480400 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1790710876.994334:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480400/0xcbad34b2815719cf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710876.994341:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480400/0xcbad34b2815719cf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710876.994354:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c51cca25000) 00010000:00010000:1.0:1790710876.994357:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790710876.994361:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480400/0xcbad34b2815719cf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710876.994366:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480400/0xcbad34b2815719cf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710876.994376:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b2815719d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710876.994381:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b2815719d6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710876.994396:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b2815719d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710876.994400:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c6480c00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1790710876.994403:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b2815719d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710876.994409:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b2815719d6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710876.994418:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c51d8e33a00) 00010000:00010000:1.0:1790710876.994420:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790710876.994423:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b2815719d6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710876.994429:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b2815719d6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710876.994470:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481200/0xcbad34b2815719c8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570006e7 expref: 27 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710876.994484:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b2815719dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570006e7 expref: 26 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710876.994492:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c51d8e33e00) 00010000:00010000:1.0:1790710876.994494:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790710876.994496:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c6481c00, rc 0) 00000100:00100000:1.0:1790710876.994552:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f3e74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+26:11515:x1877696158188032:12345-192.168.206.46@tcp:101:lfs.0 Request processed in 856us (1132us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1790710876.994568:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 188 00000100:00100000:0.0:1790710876.998688:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710876.998765:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158188160 00000100:00100000:2.0:1790710876.998774:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158188160 00000100:00100000:2.0:1790710876.998826:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 189 00000100:00100000:2.0:1790710876.998847:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9767800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+26:11515:x1877696158188160:12345-192.168.206.46@tcp:54:lfs.0 00010000:00010000:2.0:1790710876.998908:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8200/0xcbad34b2815719eb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710876.998924:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8200/0xcbad34b2815719eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710876.998935:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8200/0xcbad34b2815719eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710876.998957:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8200/0xcbad34b2815719eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710876.998964:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8200/0xcbad34b2815719eb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710876.998970:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8200/0xcbad34b2815719eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710876.998976:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51f43f8200 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1790710876.998981:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8200/0xcbad34b2815719eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710876.998988:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8200/0xcbad34b2815719eb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710876.998999:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c51d8e33e00) 00010000:00010000:2.0:1790710876.999002:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790710876.999006:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8200/0xcbad34b2815719eb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710876.999012:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8200/0xcbad34b2815719eb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710876.999106:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9767800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+26:11515:x1877696158188160:12345-192.168.206.46@tcp:54:lfs.0 Request processed in 251us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710876.999114:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 189 00000100:00100000:0.0:1790710877.001311:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710877.001384:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158188416 00000100:00100000:2.0:1790710877.001396:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158188416 00000100:00100000:2.0:1790710877.001490:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 51 00000100:00100000:2.0:1790710877.001501:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9764700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+26:11515:x1877696158188416:12345-192.168.206.46@tcp:35:lfs.0 00000100:00100000:2.0:1790710877.001741:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9764700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+27:11515:x1877696158188416:12345-192.168.206.46@tcp:35:lfs.0 Request processed in 241us (442us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1790710877.001749:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 51 00000100:00100000:3.0:1790710877.027521:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710877.027634:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158188672 00000100:00100000:2.0:1790710877.027647:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158188672 00000100:00100000:2.0:1790710877.027732:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 190 00000100:00100000:2.0:1790710877.027744:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f498dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+27:11042:x1877696158188672:12345-192.168.206.46@tcp:101:bash.0 00010000:00010000:2.0:1790710877.027776:0:8060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790710877.027804:0:8060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8200/0xcbad34b2815719f2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b0570006ee expref: -99 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.027958:0:8060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8c00/0xcbad34b2815719f9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.027975:0:8060:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b2815719dd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570006e7 expref: 28 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.027986:0:8060:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8c00/0xcbad34b2815719f9 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.028051:0:8060:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b2815719dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.46@tcp remote: 0x566877b0570006e7 expref: 28 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.028066:0:8060:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b2815719dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570006e7 expref: 28 pid: 5846 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710877.028081:0:8060:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4008e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8060:1877696177056512:192.168.206.46@tcp:104: 00000100:00100000:2.0:1790710877.028312:0:8060:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f4013f00 going to sleep for 11 seconds 00000100:00100000:0.0:1790710877.037251:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710877.038429:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158188800 00000100:00100000:1.0:1790710877.038443:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158188800 00010000:00010000:1.0:1790710877.038492:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b2815719dd lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570006e7 expref: 29 pid: 5846 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710877.038593:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 71 00000100:00100000:1.0:1790710877.038603:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9765880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+29:2359:x1877696158188800:12345-192.168.206.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790710877.038620:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790710877.038627:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b2815719dd lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570006e7 expref: 29 pid: 5846 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.038640:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b2815719dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570006e7 expref: 29 pid: 5846 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.038661:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c51d8e33e00) 00010000:00010000:1.0:1790710877.038667:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8c00/0xcbad34b2815719f9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.038676:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8c00/0xcbad34b2815719f9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.038683:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8c00/0xcbad34b2815719f9 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.038700:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790710877.038764:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9765880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+29:2359:x1877696158188800:12345-192.168.206.46@tcp:103:ldlm_bl.0 Request processed in 163us (1528us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710877.038788:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 71 00010000:00010000:2.0:1790710877.038988:0:8060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b2815719dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570006e7 expref: 28 pid: 5846 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710877.039016:0:8060:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4008e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8060:1877696177056512:192.168.206.46@tcp:104: 00010000:00010000:2.0:1790710877.039047:0:8060:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8c00/0xcbad34b2815719f9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.039059:0:8060:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8c00/0xcbad34b2815719f9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.039066:0:8060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8c00/0xcbad34b2815719f9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790710877.039092:0:8060:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1790710877.040015:0:8060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8200/0xcbad34b2815719f2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570006ee expref: 29 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.040041:0:8060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8c00/0xcbad34b2815719f9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570006ee expref: 28 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.040073:0:8060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c51d8e33e00) 00010000:00010000:2.0:1790710877.040077:0:8060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790710877.040081:0:8060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51f43f8c00, rc 0) 00000100:00100000:2.0:1790710877.040193:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f498dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+28:11042:x1877696158188672:12345-192.168.206.46@tcp:101:bash.0 Request processed in 12449us (12684us total) trans 4294967473 rc 0/0 00000100:00100000:2.0:1790710877.040203:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 190 00000100:00100000:0.0:1790710877.050702:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710877.050806:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158189056 00000100:00100000:2.0:1790710877.050816:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158189056 00000100:00100000:2.0:1790710877.050910:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 191 00000100:00100000:2.0:1790710877.050921:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff60ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+28:11042:x1877696158189056:12345-192.168.206.46@tcp:36:bash.0 00010000:00010000:2.0:1790710877.051215:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8200/0xcbad34b281571a07 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.051231:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8200/0xcbad34b281571a07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.051252:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8200/0xcbad34b281571a07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790710877.051302:0:5847:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967474 00000004:00010000:2.0:1790710877.051326:0:5847:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000009d78ecec reply state 00000000a73fea25 transno 4294967475 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8200/0xcbad34b281571a07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710877.051335:0:5847:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1790710877.051381:0:5847:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967475 00000100:00100000:2.0:1790710877.051479:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff60ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+32:11042:x1877696158189056:12345-192.168.206.46@tcp:36:bash.0 Request processed in 559us (784us total) trans 4294967476 rc 0/0 00000100:00100000:2.0:1790710877.051487:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 191 00000020:00080000:2.0:1790710877.051502:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:2.0:1790710877.053457:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8200/0xcbad34b281571a07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.053471:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8200/0xcbad34b281571a07 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.053478:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8200/0xcbad34b281571a07 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.053485:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51f43f8200 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1790710877.053489:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8200/0xcbad34b281571a07 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.053497:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8200/0xcbad34b281571a07 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.053512:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c51d8e33e00) 00010000:00010000:2.0:1790710877.053515:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790710877.053520:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8200/0xcbad34b281571a07 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.053526:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8200/0xcbad34b281571a07 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710877.053931:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710877.054853:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158189184 00000100:00100000:1.0:1790710877.054863:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158189184 00000100:00100000:1.0:1790710877.054985:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 192 00000100:00100000:1.0:1790710877.054996:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff60e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+31:11042:x1877696158189184:12345-192.168.206.46@tcp:101:bash.0 00010000:00010000:1.0:1790710877.055022:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790710877.055043:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481200/0xcbad34b281571a0e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b0570006f5 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.055117:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481200/0xcbad34b281571a0e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570006f5 expref: 32 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.055176:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481200/0xcbad34b281571a0e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570006f5 expref: 32 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.055197:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c51d8e33e00) 00010000:00010000:1.0:1790710877.055200:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790710877.055203:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c6481200, rc 0) 00000100:00100000:1.0:1790710877.055266:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff60e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+32:11042:x1877696158189184:12345-192.168.206.46@tcp:101:bash.0 Request processed in 271us (1338us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710877.055273:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 192 00000100:00100000:0.0:1790710877.059442:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710877.059526:0:6696:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158189312 00000100:00100000:2.0:1790710877.059535:0:6696:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158189312 00000100:00100000:2.0:1790710877.059606:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 58 00000100:00100000:2.0:1790710877.059616:0:6696:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff60fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+7:11042:x1877696158189312:12345-192.168.206.46@tcp:101:bash.0 00010000:00010000:2.0:1790710877.059634:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790710877.059655:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000363dfc64/0xcbad34b281571a15 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b0570006fc expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790710877.059697:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6abc1459, atime: 0x6abc1458, ctime: 0x6abc1459, blocks: 0xb 00010000:00010000:2.0:1790710877.059718:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=354s v=(0 0) 00010000:00010000:2.0:1790710877.059723:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790710877.059731:0:6696:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000363dfc64/0xcbad34b281571a15 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.46@tcp remote: 0x566877b0570006fc expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.059747:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000363dfc64/0xcbad34b281571a15 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.46@tcp remote: 0x566877b0570006fc expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.059759:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51f43f8800, rc 0) 00000100:00100000:2.0:1790710877.059817:0:6696:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff60fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+8:11042:x1877696158189312:12345-192.168.206.46@tcp:101:bash.0 Request processed in 203us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710877.059824:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 58 00000100:00080000:1.0:1790710877.060064:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790710877.062362:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710877.062482:0:6702:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158189440 00000100:00100000:2.0:1790710877.062496:0:6702:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158189440 00002000:00010000:2.0:1790710877.062552:0:6702:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:2.0:1790710877.062558:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c51ff60f800 with x1877696158189440 ext(0->18446744073709551615) 00002000:00010000:2.0:1790710877.062573:0:6702:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c51ff60f800. 00000100:00100000:2.0:1790710877.062617:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 5 00000100:00100000:2.0:1790710877.062628:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff60f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+8:2359:x1877696158189440:12345-192.168.206.46@tcp:10:bash.0 00002000:00010000:2.0:1790710877.063416:0:6702:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1790710877.063422:0:6702:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1790710873 -> 1790710876 00002000:00010000:2.0:1790710877.063425:0:6702:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1790710872 -> 1790710872 00002000:00010000:2.0:1790710877.063427:0:6702:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1790710873 -> 1790710876 00002000:00010000:2.0:1790710877.063438:0:6702:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1790710877.063613:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff60f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+9:2359:x1877696158189440:12345-192.168.206.46@tcp:10:bash.0 Request processed in 984us (1264us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1790710877.063624:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 5 00002000:00010000:2.0:1790710877.063629:0:6702:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:2.0:1790710877.063632:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c51ff60f800 with x1877696158189440 ext(0->18446744073709551615) 00002000:00010000:2.0:1790710877.063638:0:6702:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c51ff60f800. 00000100:00100000:0.0:1790710877.109435:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710877.109572:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158189568 00000100:00100000:1.0:1790710877.109585:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158189568 00000100:00100000:1.0:1790710877.109700:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 193 00000100:00100000:1.0:1790710877.109711:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff60c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+32:11529:x1877696158189568:12345-192.168.206.46@tcp:34:lfs.0 00010000:00010000:1.0:1790710877.109834:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571a1c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.109855:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571a1c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.109868:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571a1c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.109884:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480400/0xcbad34b281571a23 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.109891:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480400/0xcbad34b281571a23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.109897:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480400/0xcbad34b281571a23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.110259:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571a2a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.110267:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571a2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.110274:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571a2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790710877.110321:0:5845:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571a2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.110394:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571a1c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.110412:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571a1c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.110420:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571a1c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.110426:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c6480c00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1790710877.110431:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571a1c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.110440:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571a1c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.110453:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c51cca25000) 00010000:00010000:1.0:1790710877.110457:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790710877.110462:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571a1c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.110468:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571a1c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.110482:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480400/0xcbad34b281571a23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.110488:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480400/0xcbad34b281571a23 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.110495:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480400/0xcbad34b281571a23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.110500:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c6480400 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1790710877.110508:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480400/0xcbad34b281571a23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.110514:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480400/0xcbad34b281571a23 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.110521:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c51d8e33a00) 00010000:00010000:1.0:1790710877.110524:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790710877.110526:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480400/0xcbad34b281571a23 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.110532:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480400/0xcbad34b281571a23 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.110550:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571a2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.110554:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571a2a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.110560:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571a2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.110564:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c6481000 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1790710877.110567:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571a2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.110571:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571a2a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.110576:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c51d8e33e00) 00010000:00010000:1.0:1790710877.110578:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790710877.110586:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571a2a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.110592:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571a2a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710877.110723:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff60c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+32:11529:x1877696158189568:12345-192.168.206.46@tcp:34:lfs.0 Request processed in 1012us (1299us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710877.110732:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 193 00000100:00100000:0.0:1790710877.141267:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710877.143319:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158189824 00000100:00100000:2.0:1790710877.143340:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158189824 00000100:00100000:2.0:1790710877.143445:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 194 00000100:00100000:2.0:1790710877.143458:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff60d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+32:11532:x1877696158189824:12345-192.168.206.46@tcp:101:lfs.0 00010000:00010000:2.0:1790710877.143487:0:8060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790710877.143515:0:8060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8200/0xcbad34b281571a31 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b057000703 expref: -99 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.143623:0:8060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9000/0xcbad34b281571a38 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.143641:0:8060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9000/0xcbad34b281571a38 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.143653:0:8060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9000/0xcbad34b281571a38 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.143669:0:8060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8a00/0xcbad34b281571a3f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.143677:0:8060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8a00/0xcbad34b281571a3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.143705:0:8060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8a00/0xcbad34b281571a3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.144277:0:8060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9200/0xcbad34b281571a46 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.144288:0:8060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9200/0xcbad34b281571a46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.144296:0:8060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9200/0xcbad34b281571a46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790710877.144308:0:8060:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1790710877.144423:0:8060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9000/0xcbad34b281571a38 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.144432:0:8060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9000/0xcbad34b281571a38 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.144438:0:8060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9000/0xcbad34b281571a38 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.144445:0:8060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51f43f9000 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1790710877.144450:0:8060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9000/0xcbad34b281571a38 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.144458:0:8060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9000/0xcbad34b281571a38 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.144470:0:8060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c51cca25000) 00010000:00010000:2.0:1790710877.144473:0:8060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790710877.144486:0:8060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9000/0xcbad34b281571a38 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.144493:0:8060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9000/0xcbad34b281571a38 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.144507:0:8060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8a00/0xcbad34b281571a3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.144513:0:8060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8a00/0xcbad34b281571a3f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.145491:0:8060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8a00/0xcbad34b281571a3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.145499:0:8060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51f43f8a00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1790710877.145504:0:8060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8a00/0xcbad34b281571a3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.145512:0:8060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8a00/0xcbad34b281571a3f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.145538:0:8060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c51cca25400) 00010000:00010000:2.0:1790710877.145542:0:8060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790710877.145546:0:8060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8a00/0xcbad34b281571a3f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.145552:0:8060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8a00/0xcbad34b281571a3f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.145625:0:8060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8200/0xcbad34b281571a31 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000703 expref: 35 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.145661:0:8060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9200/0xcbad34b281571a46 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000703 expref: 34 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.145668:0:8060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c51d8e33e00) 00010000:00010000:2.0:1790710877.145670:0:8060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1790710877.145673:0:8060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51f43f9200, rc 0) 00000100:00100000:2.0:1790710877.145778:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff60d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+34:11532:x1877696158189824:12345-192.168.206.46@tcp:101:lfs.0 Request processed in 2322us (4521us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1790710877.145789:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 194 00000100:00100000:0.0:1790710877.149174:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710877.149229:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158189952 00000100:00100000:1.0:1790710877.149242:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158189952 00000100:00100000:1.0:1790710877.149314:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 297 00000100:00100000:0.0:1790710877.149328:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710877.149329:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8ffa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b75d7a5-152f-4db9-bf19-5fe279a322e3+13:2358:x1877696158189952:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:0.0:1790710877.149396:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710877.149427:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8ffa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b75d7a5-152f-4db9-bf19-5fe279a322e3+13:2358:x1877696158189952:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 99us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710877.149435:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 297 00000100:00100000:1.0:1790710877.149516:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158190080 00000100:00100000:1.0:1790710877.149537:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158190080 00000100:00100000:1.0:1790710877.149587:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 86 00000100:00080000:0.0:1790710877.149587:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790710877.149596:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff047b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+5:2358:x1877696158190080:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:1.0:1790710877.149641:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff047b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+5:2358:x1877696158190080:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 47us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710877.149647:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 86 00000100:00100000:3.0:1790710877.149738:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158190208 00000100:00100000:3.0:1790710877.149749:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158190208 00000100:00100000:3.0:1790710877.149798:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 155 00000100:00100000:3.0:1790710877.149806:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff044e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1b59f23d-9a5c-439d-bd4a-453bf2315b97+5:2358:x1877696158190208:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:3.0:1790710877.149842:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff044e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1b59f23d-9a5c-439d-bd4a-453bf2315b97+5:2358:x1877696158190208:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 38us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710877.149849:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 155 00000100:00080000:1.0:1790710877.150537:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790710877.151475:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710877.152269:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158190336 00000100:00100000:1.0:1790710877.152284:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158190336 00000100:00100000:1.0:1790710877.152359:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 195 00000100:00100000:1.0:1790710877.152371:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff045500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+34:11532:x1877696158190336:12345-192.168.206.46@tcp:54:lfs.0 00010000:00010000:1.0:1790710877.152743:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571a54 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.152767:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8c00/0xcbad34b2815719f9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570006ee expref: 34 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.152778:0:5846:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571a54 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.152823:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8c00/0xcbad34b2815719f9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.46@tcp remote: 0x566877b0570006ee expref: 34 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.152840:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8c00/0xcbad34b2815719f9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570006ee expref: 34 pid: 8060 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710877.152856:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51ff87dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1877696177056640:192.168.206.46@tcp:104: 00000100:00100000:1.0:1790710877.152974:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c8b993c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790710877.155557:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51ff87dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1877696177056640:192.168.206.46@tcp:104: 00010000:00010000:1.0:1790710877.155678:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571a54 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710877.155906:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710877.156611:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158190592 00000100:00100000:1.0:1790710877.156621:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158190592 00000100:00100000:1.0:1790710877.156698:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 52 00000100:00100000:1.0:1790710877.156710:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff044a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+35:5593:x1877696158190592:12345-192.168.206.46@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1790710877.157247:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff044a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+36:5593:x1877696158190592:12345-192.168.206.46@tcp:35:ldlm_bl.0 Request processed in 536us (1338us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1790710877.157278:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 52 00000100:00100000:0.0:1790710877.162614:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710877.163497:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158190720 00000100:00100000:1.0:1790710877.163513:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158190720 00010000:00010000:1.0:1790710877.164628:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8c00/0xcbad34b2815719f9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570006ee expref: 36 pid: 8060 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710877.164774:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 72 00000100:00100000:1.0:1790710877.164795:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff047100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+36:2358:x1877696158190720:12345-192.168.206.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790710877.164819:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790710877.164827:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8c00/0xcbad34b2815719f9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570006ee expref: 36 pid: 8060 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.164842:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8c00/0xcbad34b2815719f9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570006ee expref: 36 pid: 8060 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.164867:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8c00/0xcbad34b2815719f9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570006ee expref: 36 pid: 8060 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.164888:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c51d8e33e00) 00010000:00010000:1.0:1790710877.164893:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571a54 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.164904:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571a54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.164911:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571a54 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.164972:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790710877.165058:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff047100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+35:2358:x1877696158190720:12345-192.168.206.46@tcp:103:ldlm_bl.0 Request processed in 273us (2457us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710877.165067:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 72 00010000:00010000:0.0:1790710877.165349:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571a54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.165359:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571a54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.165404:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571a54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.165413:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571a54 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.165419:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571a54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.165425:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c6481000 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1790710877.165430:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571a54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.165444:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571a54 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.165454:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c51d8e33e00) 00010000:00010000:0.0:1790710877.165456:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790710877.165460:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571a54 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.165467:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571a54 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710877.165534:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff045500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+34:11532:x1877696158190336:12345-192.168.206.46@tcp:54:lfs.0 Request processed in 13165us (14069us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710877.165544:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 195 00000100:00100000:0.0:1790710877.171301:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710877.171452:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158190976 00000100:00100000:1.0:1790710877.171466:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158190976 00000100:00100000:1.0:1790710877.171539:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 53 00000100:00100000:1.0:1790710877.171550:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff045180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+34:11532:x1877696158190976:12345-192.168.206.46@tcp:35:lfs.0 00000100:00100000:1.0:1790710877.171855:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff045180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+35:11532:x1877696158190976:12345-192.168.206.46@tcp:35:lfs.0 Request processed in 306us (567us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1790710877.171864:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 53 00000100:00100000:2.0:1790710877.253108:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710877.255660:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158191232 00000100:00100000:3.0:1790710877.255683:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158191232 00000100:00100000:1.0:1790710877.256940:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 196 00000100:00100000:1.0:1790710877.256965:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4008e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+35:11543:x1877696158191232:12345-192.168.206.46@tcp:101:cat.0 00010000:00010000:1.0:1790710877.257002:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790710877.257032:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480400/0xcbad34b281571a5b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b05700070a expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.257171:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571a62 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.258157:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571a62 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.258176:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571a62 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.258207:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571a69 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.258235:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571a69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.258243:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571a69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.258890:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b281571a70 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.258903:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b281571a70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.258911:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b281571a70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790710877.258925:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:1.0:1790710877.259183:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571a62 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.259192:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571a62 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.259200:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571a62 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.259206:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c6480c00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1790710877.259212:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571a62 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.259222:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571a62 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.259260:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c51cca25000) 00010000:00010000:1.0:1790710877.259264:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790710877.259270:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571a62 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.259278:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571a62 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.259297:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571a69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.259304:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571a69 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.259311:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571a69 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.259317:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c6481000 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1790710877.259321:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571a69 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.259399:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571a69 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.259406:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c51d8e33a00) 00010000:00010000:1.0:1790710877.259408:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790710877.259411:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571a69 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.259417:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571a69 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.259496:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480400/0xcbad34b281571a5b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700070a expref: 38 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.259515:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b281571a70 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700070a expref: 37 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.262681:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c51d8e33e00) 00010000:00010000:1.0:1790710877.262685:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790710877.262691:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c6481c00, rc 0) 00000100:00100000:1.0:1790710877.262812:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4008e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+37:11543:x1877696158191232:12345-192.168.206.46@tcp:101:cat.0 Request processed in 5851us (9723us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1790710877.262825:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 196 00000100:00100000:0.0:1790710877.272205:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710877.272286:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158191488 00000100:00100000:1.0:1790710877.272299:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158191488 00000100:00100000:1.0:1790710877.272374:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 54 00000100:00100000:1.0:1790710877.272385:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff045880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+37:11543:x1877696158191488:12345-192.168.206.46@tcp:35:cat.0 00000100:00100000:1.0:1790710877.272903:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff045880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+38:11543:x1877696158191488:12345-192.168.206.46@tcp:35:cat.0 Request processed in 516us (707us total) trans 4294967481 rc 0/0 00000100:00100000:1.0:1790710877.272913:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 54 00000100:00100000:0.0:1790710877.311695:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710877.318555:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158191744 00000100:00100000:2.0:1790710877.318578:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158191744 00000100:00100000:2.0:1790710877.318667:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 197 00000100:00100000:2.0:1790710877.318680:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff044380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+38:11544:x1877696158191744:12345-192.168.206.46@tcp:36:rm.0 00010000:00010000:2.0:1790710877.318755:0:8060:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1790710877.318789:0:8060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b281571a70 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700070a expref: 38 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.318818:0:8060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9200/0xcbad34b281571a46 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000703 expref: 37 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.318833:0:8060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481200/0xcbad34b281571a0e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570006f5 expref: 36 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.318844:0:8060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c51d8e33e00) 00010000:00010000:2.0:1790710877.318877:0:8060:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790710877.318903:0:8060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8e00/0xcbad34b281571a7e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.318920:0:8060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8e00/0xcbad34b281571a7e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.318932:0:8060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8e00/0xcbad34b281571a7e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.318948:0:8060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8400/0xcbad34b281571a85 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.319787:0:8060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8400/0xcbad34b281571a85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.319806:0:8060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8400/0xcbad34b281571a85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.320170:0:8060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9800/0xcbad34b281571a8c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.320183:0:8060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9800/0xcbad34b281571a8c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.320191:0:8060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9800/0xcbad34b281571a8c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790710877.324941:0:8060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:2.0:1790710877.325172:0:8060:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 354662042900ns, next at 355661825167ns, rc = 0 00010000:00010000:2.0:1790710877.325508:0:8060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9a00/0xcbad34b281571a93 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.325547:0:8060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9a00/0xcbad34b281571a93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.325561:0:8060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9a00/0xcbad34b281571a93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.325572:0:8060:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9a00/0xcbad34b281571a93 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.325579:0:8060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9a00/0xcbad34b281571a93 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.325586:0:8060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9a00/0xcbad34b281571a93 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.325668:0:8060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790710877.325698:0:8060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9800/0xcbad34b281571a8c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.325705:0:8060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9800/0xcbad34b281571a8c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.325713:0:8060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9800/0xcbad34b281571a8c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.325720:0:8060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51f43f9800 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1790710877.325724:0:8060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9800/0xcbad34b281571a8c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.325733:0:8060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9800/0xcbad34b281571a8c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.325758:0:8060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c51cca25800) 00010000:00010000:2.0:1790710877.325762:0:8060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1790710877.325768:0:8060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9800/0xcbad34b281571a8c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.325775:0:8060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9800/0xcbad34b281571a8c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.325799:0:8060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8e00/0xcbad34b281571a7e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.325806:0:8060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8e00/0xcbad34b281571a7e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.325813:0:8060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8e00/0xcbad34b281571a7e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.325818:0:8060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51f43f8e00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1790710877.325821:0:8060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8e00/0xcbad34b281571a7e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.325827:0:8060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8e00/0xcbad34b281571a7e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.325847:0:8060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c51cca25000) 00010000:00010000:2.0:1790710877.325850:0:8060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790710877.325853:0:8060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8e00/0xcbad34b281571a7e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.325859:0:8060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8e00/0xcbad34b281571a7e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790710877.325881:0:8060:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000012013aba reply state 00000000e9e6fbbd transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8400/0xcbad34b281571a85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710877.325891:0:8060:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790710877.326025:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff044380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+37:11544:x1877696158191744:12345-192.168.206.46@tcp:36:rm.0 Request processed in 7343us (14340us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1790710877.326037:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 197 00010000:00010000:0.0:1790710877.328029:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790710877.328048:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9a00/0xcbad34b281571a93 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.328061:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51f43f9a00 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:0.0:1790710877.328066:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9a00/0xcbad34b281571a93 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.328089:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9a00/0xcbad34b281571a93 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.328118:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c51cca25800) 00010000:00010000:0.0:1790710877.328122:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1790710877.328140:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9a00/0xcbad34b281571a93 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.328148:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9a00/0xcbad34b281571a93 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.328188:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790710877.328191:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790710877.328199:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790710877.335017:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8400/0xcbad34b281571a85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.335041:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8400/0xcbad34b281571a85 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.335050:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8400/0xcbad34b281571a85 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.335076:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51f43f8400 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1790710877.335081:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8400/0xcbad34b281571a85 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.335092:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8400/0xcbad34b281571a85 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.336728:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c51cca25400) 00010000:00010000:1.0:1790710877.336740:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790710877.336751:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8400/0xcbad34b281571a85 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.336761:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8400/0xcbad34b281571a85 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710877.380894:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710877.381451:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158192000 00000100:00100000:2.0:1790710877.381465:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158192000 00000100:00100000:2.0:1790710877.381544:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 198 00000100:00100000:2.0:1790710877.381556:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff046d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+36:11550:x1877696158192000:12345-192.168.206.46@tcp:101:bash.0 00010000:00010000:2.0:1790710877.381591:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790710877.381618:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8e00/0xcbad34b281571a9a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b057000711 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.381868:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9800/0xcbad34b281571aa1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.381887:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9800/0xcbad34b281571aa1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.381900:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9800/0xcbad34b281571aa1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.381918:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9200/0xcbad34b281571aa8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.381924:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9200/0xcbad34b281571aa8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.381944:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9200/0xcbad34b281571aa8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790710877.386944:0:5847:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:3.0:1790710877.388300:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b281571aaf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.388326:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b281571aaf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.388339:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b281571aaf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.388384:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9800/0xcbad34b281571aa1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.388393:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9800/0xcbad34b281571aa1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.388412:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9800/0xcbad34b281571aa1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.388418:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51f43f9800 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1790710877.388423:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9800/0xcbad34b281571aa1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.388452:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9800/0xcbad34b281571aa1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.388466:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c51cca25000) 00010000:00010000:3.0:1790710877.388469:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790710877.388474:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9800/0xcbad34b281571aa1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.388481:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9800/0xcbad34b281571aa1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790710877.388499:0:5847:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000698f45c7 reply state 00000000a049a120 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9200/0xcbad34b281571aa8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710877.388508:0:5847:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1790710877.388547:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8e00/0xcbad34b281571a9a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000711 expref: 39 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.388561:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b281571aaf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000711 expref: 38 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.388569:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c51c2c2e000) 00010000:00010000:3.0:1790710877.388572:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790710877.388574:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c8047800, rc 0) 00000100:00100000:3.0:1790710877.388672:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff046d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+39:11550:x1877696158192000:12345-192.168.206.46@tcp:101:bash.0 Request processed in 7118us (7791us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1790710877.388690:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 198 00010000:00010000:0.0:1790710877.391896:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9200/0xcbad34b281571aa8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.391918:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9200/0xcbad34b281571aa8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.391927:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9200/0xcbad34b281571aa8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.391934:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51f43f9200 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1790710877.391940:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9200/0xcbad34b281571aa8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.391947:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9200/0xcbad34b281571aa8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.391965:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c51cca25400) 00010000:00010000:0.0:1790710877.391969:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790710877.391974:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9200/0xcbad34b281571aa8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.391980:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9200/0xcbad34b281571aa8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710877.394249:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710877.394370:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158192128 00000100:00100000:3.0:1790710877.394400:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158192128 00000100:00100000:3.0:1790710877.394463:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 59 00000100:00100000:3.0:1790710877.394475:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff047480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+5:2356:x1877696158192128:12345-192.168.206.46@tcp:101:bash.0 00010000:00010000:3.0:1790710877.394498:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790710877.394524:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b271cda/0xcbad34b281571abd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b057000718 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790710877.394557:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790710877.394581:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=354s v=(0 0) 00010000:00010000:3.0:1790710877.394586:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790710877.394598:0:6698:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b271cda/0xcbad34b281571abd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000718 expref: 6 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.394621:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006b271cda/0xcbad34b281571abd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000718 expref: 6 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.394637:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c8046800, rc 0) 00000100:00100000:3.0:1790710877.394709:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff047480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:2356:x1877696158192128:12345-192.168.206.46@tcp:101:bash.0 Request processed in 235us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710877.394717:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 59 00000100:00100000:2.0:1790710877.402279:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710877.402399:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158192256 00000100:00100000:1.0:1790710877.402411:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158192256 00000100:00100000:1.0:1790710877.402480:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 60 00000100:00100000:1.0:1790710877.402492:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d03f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:11550:x1877696158192256:12345-192.168.206.46@tcp:101:bash.0 00010000:00010000:1.0:1790710877.402515:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790710877.402538:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050b71f0c/0xcbad34b281571ac4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b05700071f expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.402578:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006b271cda/0xcbad34b281571abd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000718 expref: 7 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.402588:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790710877.402592:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790710877.402606:0:6697:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050b71f0c/0xcbad34b281571ac4 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700071f expref: 7 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.402649:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006b271cda/0xcbad34b281571abd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.46@tcp remote: 0x566877b057000718 expref: 7 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.402665:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006b271cda/0xcbad34b281571abd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000718 expref: 7 pid: 6698 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710877.402680:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51ff87dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6697:1877696177056768:192.168.206.46@tcp:104: 00000100:00100000:1.0:1790710877.402787:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c8b99600 going to sleep for 11 seconds 00000100:00100000:1.0:1790710877.414234:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710877.414926:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51ff87dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6697:1877696177056768:192.168.206.46@tcp:104: 00010000:00010000:2.0:1790710877.414981:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000050b71f0c/0xcbad34b281571ac4 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.46@tcp remote: 0x566877b05700071f expref: 7 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.415073:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c6481400, rc 0) 00000100:00100000:0.0:1790710877.415149:0:8449:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158192384 00000100:00100000:0.0:1790710877.415158:0:8449:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158192384 00000100:00100000:2.0:1790710877.415199:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d03f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+8:11550:x1877696158192256:12345-192.168.206.46@tcp:101:bash.0 Request processed in 12708us (12932us total) trans 0 rc 0/0 00010000:00010000:0.0:1790710877.415200:0:8449:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006b271cda/0xcbad34b281571abd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000718 expref: 8 pid: 6698 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710877.415210:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 60 00000100:00100000:0.0:1790710877.415241:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 73 00000100:00100000:0.0:1790710877.415250:0:8449:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff87f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+7:2358:x1877696158192384:12345-192.168.206.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790710877.415285:0:8449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790710877.415311:0:8449:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006b271cda/0xcbad34b281571abd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000718 expref: 7 pid: 6698 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.415326:0:8449:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006b271cda/0xcbad34b281571abd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000718 expref: 7 pid: 6698 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.415363:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b271cda/0xcbad34b281571abd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000718 expref: 7 pid: 6698 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.415382:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790710877.415386:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790710877.415668:0:8449:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000050b71f0c/0xcbad34b281571ac4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.46@tcp remote: 0x566877b05700071f expref: 6 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.415682:0:8449:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050b71f0c/0xcbad34b281571ac4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.46@tcp remote: 0x566877b05700071f expref: 6 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.415730:0:8449:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000050b71f0c/0xcbad34b281571ac4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.46@tcp remote: 0x566877b05700071f expref: 6 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710877.415747:0:8449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51ff046680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8449:1877696177056896:192.168.206.46@tcp:105: 00000100:00100000:0.0:1790710877.415857:0:8449:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51e0052900 going to sleep for 11 seconds 00000100:00100000:0.0:1790710877.422273:0:8449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51ff046680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8449:1877696177056896:192.168.206.46@tcp:105: 00010000:00010000:0.0:1790710877.422311:0:8449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790710877.422431:0:8449:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff87f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:2358:x1877696158192384:12345-192.168.206.46@tcp:103:ldlm_bl.0 Request processed in 7179us (8208us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710877.422444:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 73 00000100:00100000:1.0:1790710877.424606:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710877.427520:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158192640 00000100:00100000:2.0:1790710877.427540:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158192640 00000100:00100000:2.0:1790710877.427645:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 55 00000100:00100000:2.0:1790710877.427663:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff87dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+38:11550:x1877696158192640:12345-192.168.206.46@tcp:35:bash.0 00000100:00100000:2.0:1790710877.428175:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff87dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+39:11550:x1877696158192640:12345-192.168.206.46@tcp:35:bash.0 Request processed in 516us (3579us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1790710877.428187:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 55 00000100:00100000:3.0:1790710877.556124:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710877.561087:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158192768 00000100:00100000:0.0:1790710877.561120:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158192768 00000100:00100000:0.0:1790710877.561234:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 199 00000100:00100000:0.0:1790710877.561246:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f498c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+39:11566:x1877696158192768:12345-192.168.206.46@tcp:101:lfs.0 00010000:00010000:0.0:1790710877.561281:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790710877.561307:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243aa00/0xcbad34b281571acb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b057000726 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.561402:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b600/0xcbad34b281571ad2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.561421:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b600/0xcbad34b281571ad2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.561434:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b600/0xcbad34b281571ad2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790710877.561476:0:5846:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1790710877.561480:0:5846:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790710877.561503:0:5846:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b600/0xcbad34b281571ad2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.561532:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243aa00/0xcbad34b281571acb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000726 expref: 41 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.561554:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b600/0xcbad34b281571ad2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000726 expref: 40 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.561586:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c51cca25000) 00010000:00010000:0.0:1790710877.561590:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790710877.561594:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c243b600, rc 0) 00000100:00100000:0.0:1790710877.561685:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f498c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+40:11566:x1877696158192768:12345-192.168.206.46@tcp:101:lfs.0 Request processed in 440us (5588us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710877.561694:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 199 00000100:00100000:0.0:1790710877.567446:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710877.568154:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158193024 00000100:00100000:1.0:1790710877.568169:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158193024 00000100:00100000:1.0:1790710877.568244:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 200 00000100:00100000:1.0:1790710877.568255:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff046680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+40:11566:x1877696158193024:12345-192.168.206.46@tcp:101:lfs.0 00010000:00010000:1.0:1790710877.568280:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790710877.568307:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480200/0xcbad34b281571ad9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b05700072d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.568601:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b281571ae0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.568617:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b281571ae0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.568631:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b281571ae0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790710877.568662:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1790710877.569060:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480200/0xcbad34b281571ad9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700072d expref: 43 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.569085:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b281571ae0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700072d expref: 42 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.569103:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c51c2c2e000) 00010000:00010000:1.0:1790710877.569106:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790710877.569110:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c6480e00, rc 0) 00000100:00100000:1.0:1790710877.569312:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff046680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+42:11566:x1877696158193024:12345-192.168.206.46@tcp:101:lfs.0 Request processed in 1059us (1878us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1790710877.569321:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 200 00000040:00080000:2.0:1790710877.575750:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790710877.575763:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790710877.575982:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1790710877.575990:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790710877.579011:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710877.579091:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158193408 00000100:00100000:3.0:1790710877.579115:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158193408 00000100:00100000:3.0:1790710877.579226:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 15 00000100:00100000:3.0:1790710877.579238:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4cf0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+42:2359:x1877696158193408:12345-192.168.206.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790710877.579257:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790710877.579305:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480e00/0xcbad34b281571ae0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700072d expref: 42 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.579328:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c51c2c2e000) 00010000:00010000:3.0:1790710877.579333:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790710877.579397:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4cf0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+41:2359:x1877696158193408:12345-192.168.206.46@tcp:103:ldlm_bl.0 Request processed in 161us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710877.579406:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 15 00000100:00100000:3.0:1790710877.581505:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710877.585891:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158193280 00000100:00100000:0.0:1790710877.585913:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158193280 00000100:00100000:1.0:1790710877.586844:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 201 00000100:00100000:1.0:1790710877.586859:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f498ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+41:11566:x1877696158193280:12345-192.168.206.46@tcp:101:lfs.0 00010000:00010000:1.0:1790710877.586892:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790710877.586920:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480200/0xcbad34b281571aee lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b057000734 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.587055:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571af5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.587072:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571af5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.587085:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571af5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790710877.587162:0:5846:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1790710877.587316:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480200/0xcbad34b281571aee lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000734 expref: 44 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.587338:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571af5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000734 expref: 43 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.587348:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c51c2c2e000) 00010000:00010000:1.0:1790710877.587351:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1790710877.587356:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c6480c00, rc 0) 00000100:00100000:1.0:1790710877.587446:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f498ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+43:11566:x1877696158193280:12345-192.168.206.46@tcp:101:lfs.0 Request processed in 590us (5951us total) trans 4294967486 rc 0/0 00000100:00100000:1.0:1790710877.587454:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 201 00000100:00100000:0.0:1790710877.593848:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710877.593967:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158193536 00000100:00100000:3.0:1790710877.593994:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158193536 00000100:00100000:3.0:1790710877.594068:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 61 00000100:00100000:3.0:1790710877.594079:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff047800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+6:2357:x1877696158193536:12345-192.168.206.46@tcp:1:lfs.0 00010000:00010000:3.0:1790710877.594189:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001ad3754/0xcbad34b281571b03 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.594216:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000050b71f0c/0xcbad34b281571ac4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.46@tcp remote: 0x566877b05700071f expref: 6 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.594226:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790710877.594231:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790710877.594236:0:6698:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001ad3754/0xcbad34b281571b03 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.594281:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000050b71f0c/0xcbad34b281571ac4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.46@tcp remote: 0x566877b05700071f expref: 6 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.594321:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000050b71f0c/0xcbad34b281571ac4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.46@tcp remote: 0x566877b05700071f expref: 6 pid: 6697 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710877.594340:0:6698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f498e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6698:1877696177057024:192.168.206.46@tcp:104: 00000100:00100000:3.0:1790710877.594464:0:6698:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c3f8c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790710877.602033:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710877.602457:0:6698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f498e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6698:1877696177057024:192.168.206.46@tcp:104: 00010000:00010000:3.0:1790710877.602491:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000001ad3754/0xcbad34b281571b03 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710877.602608:0:6703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158193664 00000100:00100000:2.0:1790710877.602617:0:6703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158193664 00002000:00100000:2.0:1790710877.602696:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9c51ff046300 x1877696158193664/t0(0) o4->0ec73bd1-726e-4dc0-8edd-807d3f973d65@192.168.206.46@tcp:378/0 lens 504/0 e 0 to 0 dl 1790710888 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790710877.602725:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c51ff046300 with x1877696158193664 ext(0->8) 00010000:00010000:2.0:1790710877.602735:0:6703:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000050b71f0c/0xcbad34b281571ac4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.46@tcp remote: 0x566877b05700071f expref: 7 pid: 6697 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.602751:0:6703:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000050b71f0c/0xcbad34b281571ac4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.46@tcp remote: 0x566877b05700071f expref: 7 pid: 6697 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790710877.602759:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9c51ff046300 00000100:00100000:2.0:1790710877.602797:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 3 00000100:00100000:2.0:1790710877.602807:0:6703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff046300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+7:2358:x1877696158193664:12345-192.168.206.46@tcp:4:lfs.0 00000100:00100000:2.0:1790710877.603725:0:6703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff046300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+9:2358:x1877696158193664:12345-192.168.206.46@tcp:4:lfs.0 Request processed in 911us (1698us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1790710877.603738:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 3 00002000:00100000:2.0:1790710877.603750:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9c51ff046300 x1877696158193664/t4294967308(0) o4->0ec73bd1-726e-4dc0-8edd-807d3f973d65@192.168.206.46@tcp:378/0 lens 504/448 e 0 to 0 dl 1790710888 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790710877.603759:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c51ff046300 with x1877696158193664 ext(0->8) 00010000:00010000:2.0:1790710877.603768:0:6703:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000050b71f0c/0xcbad34b281571ac4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.46@tcp remote: 0x566877b05700071f expref: 9 pid: 6697 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.603785:0:6703:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000050b71f0c/0xcbad34b281571ac4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.46@tcp remote: 0x566877b05700071f expref: 9 pid: 6697 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790710877.603792:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9c51ff046300 00000100:00100000:0.0:1790710877.608462:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710877.608908:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158193792 00000100:00100000:1.0:1790710877.608922:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158193792 00010000:00010000:1.0:1790710877.608977:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000050b71f0c/0xcbad34b281571ac4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.46@tcp remote: 0x566877b05700071f expref: 9 pid: 6697 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710877.609176:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 74 00000100:00100000:1.0:1790710877.609188:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8e5e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+9:2359:x1877696158193792:12345-192.168.206.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790710877.609208:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1790710877.609232:0:5829:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1790710877.609251:0:5829:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1790710877 00002000:00010000:1.0:1790710877.609254:0:5829:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1790710877 00002000:00010000:1.0:1790710877.609257:0:5829:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1790710877 00010000:00010000:1.0:1790710877.609265:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000050b71f0c/0xcbad34b281571ac4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.46@tcp remote: 0x566877b05700071f expref: 9 pid: 6697 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.609295:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000050b71f0c/0xcbad34b281571ac4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.46@tcp remote: 0x566877b05700071f expref: 9 pid: 6697 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.609333:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050b71f0c/0xcbad34b281571ac4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.46@tcp remote: 0x566877b05700071f expref: 9 pid: 6697 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.609354:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790710877.609358:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790710877.609364:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000001ad3754/0xcbad34b281571b03 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.609375:0:5829:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001ad3754/0xcbad34b281571b03 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.609415:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790710877.609493:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8e5e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+8:2359:x1877696158193792:12345-192.168.206.46@tcp:103:ldlm_bl.0 Request processed in 307us (1046us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710877.609502:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 74 00010000:00010000:3.0:1790710877.609908:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000001ad3754/0xcbad34b281571b03 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.609919:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001ad3754/0xcbad34b281571b03 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.609951:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001ad3754/0xcbad34b281571b03 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.609960:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001ad3754/0xcbad34b281571b03 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.609970:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001ad3754/0xcbad34b281571b03 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.610005:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c8046e00 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:3.0:1790710877.610009:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001ad3754/0xcbad34b281571b03 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.610019:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001ad3754/0xcbad34b281571b03 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.610227:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001ad3754/0xcbad34b281571b03 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.610246:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001ad3754/0xcbad34b281571b03 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710877.610334:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff047800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+7:2357:x1877696158193536:12345-192.168.206.46@tcp:1:lfs.0 Request processed in 16243us (16487us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710877.610344:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 61 00000100:00100000:0.0:1790710877.614801:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710877.614934:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158194048 00000100:00100000:2.0:1790710877.614964:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158194048 00000100:00100000:2.0:1790710877.615186:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 56 00000100:00100000:2.0:1790710877.615198:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d6262c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+43:11566:x1877696158194048:12345-192.168.206.46@tcp:35:lfs.0 00000004:00010000:2.0:1790710877.615296:0:5848:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571af5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000734 expref: 43 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790710877.615797:0:5848:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:2.0:1790710877.615846:0:5848:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:2.0:1790710877.616958:0:5848:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967489 00010000:00010000:2.0:1790710877.617359:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8000/0xcbad34b281571b0a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.617384:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b281571aaf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000711 expref: 47 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.617395:0:5848:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8000/0xcbad34b281571b0a lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.617446:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b281571aaf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.46@tcp remote: 0x566877b057000711 expref: 47 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.617465:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b281571aaf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000711 expref: 47 pid: 5847 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710877.617482:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51d03fad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5848:1877696177057152:192.168.206.46@tcp:104: 00000100:00100000:2.0:1790710877.617664:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f4013a80 going to sleep for 11 seconds 00000100:00100000:2.0:1790710877.625721:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710877.625871:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51d03fad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5848:1877696177057152:192.168.206.46@tcp:104: 00010000:00010000:0.0:1790710877.625910:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8000/0xcbad34b281571b0a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710877.626116:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158194176 00000100:00100000:3.0:1790710877.626125:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158194176 00010000:00010000:3.0:1790710877.626190:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b281571aaf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000711 expref: 48 pid: 5847 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710877.626337:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 75 00000100:00100000:3.0:1790710877.626348:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d03fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+48:2359:x1877696158194176:12345-192.168.206.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790710877.626369:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790710877.626378:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b281571aaf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000711 expref: 48 pid: 5847 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.626409:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b281571aaf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000711 expref: 48 pid: 5847 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.626436:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b281571aaf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000711 expref: 48 pid: 5847 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.626455:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c51c2c2e000) 00010000:00010000:3.0:1790710877.626461:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8000/0xcbad34b281571b0a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.626472:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8000/0xcbad34b281571b0a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.626480:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8000/0xcbad34b281571b0a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.626513:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790710877.626589:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d03fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+47:2359:x1877696158194176:12345-192.168.206.46@tcp:103:ldlm_bl.0 Request processed in 242us (880us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710877.626597:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 75 00010000:00010000:0.0:1790710877.626657:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8000/0xcbad34b281571b0a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.626666:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8000/0xcbad34b281571b0a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790710877.626831:0:5848:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:0.0:1790710877.627111:0:5848:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:0.0:1790710877.627420:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51ff046a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5848:1877696177057280:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1790710877.627487:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710877.627545:0:5851:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177057280 00000100:00100000:0.0:1790710877.627552:0:5851:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177057280 00000100:00100000:0.0:1790710877.627594:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790710877.627602:0:5851:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff044000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5848:x1877696177057280:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1790710877.627677:0:5851:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff044000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5848:x1877696177057280:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 76us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710877.627684:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790710877.627720:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f01e6d80 going to sleep for 11 seconds 00000100:00100000:0.0:1790710877.627747:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51ff046a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5848:1877696177057280:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1790710877.628548:0:5848:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:0.0:1790710877.628632:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51ff046a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5848:1877696177057408:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1790710877.628689:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710877.628740:0:5851:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177057408 00000100:00100000:0.0:1790710877.628745:0:5851:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177057408 00000100:00100000:0.0:1790710877.628785:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790710877.628793:0:5851:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff045c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5848:x1877696177057408:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1790710877.629274:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51e0052900 going to sleep for 11 seconds 00000100:00100000:0.0:1790710877.632087:0:5851:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff045c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5848:x1877696177057408:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 3283us (3385us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1790710877.632118:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790710877.632285:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51ff046a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5848:1877696177057408:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1790710877.632398:0:5848:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:1.0:1790710877.632470:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8000/0xcbad34b281571b0a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.632482:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8000/0xcbad34b281571b0a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.632513:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8000/0xcbad34b281571b0a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.632520:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51f43f8000 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1790710877.632525:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8000/0xcbad34b281571b0a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.632534:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8000/0xcbad34b281571b0a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.632552:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c51c2c2e000) 00010000:00010000:1.0:1790710877.632555:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1790710877.632561:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8000/0xcbad34b281571b0a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.632568:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8000/0xcbad34b281571b0a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790710877.632837:0:5848:0:(mdd_object.c:4180:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1790710877.634417:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:1.0:1790710877.634442:0:5848:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 354971313261ns, next at 355971308968ns, rc = 0 00000001:00080000:1.0:1790710877.634456:0:5848:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:1.0:1790710877.634536:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c51c2c2e000) 00010000:00010000:1.0:1790710877.634540:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1790710877.634553:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571af5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000734 expref: 51 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710877.634737:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d6262c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+50:11566:x1877696158194048:12345-192.168.206.46@tcp:35:lfs.0 Request processed in 19540us (19948us total) trans 4294967495 rc 0/0 00000100:00100000:1.0:1790710877.634768:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 56 00000020:00080000:1.0:1790710877.634775:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1790710877.640465:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710877.640650:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158194304 00000100:00100000:3.0:1790710877.640663:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158194304 00000100:00100000:3.0:1790710877.640771:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 202 00000100:00100000:3.0:1790710877.640783:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d03fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+50:11566:x1877696158194304:12345-192.168.206.46@tcp:101:lfs.0 00010000:00010000:3.0:1790710877.640817:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790710877.640851:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b281571b11 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b05700073b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.640972:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b281571b11 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700073b expref: 51 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.640989:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b281571b11 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700073b expref: 51 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.641012:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c51c2c2e800) 00010000:00010000:3.0:1790710877.641016:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790710877.641020:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c8047800, rc 0) 00000100:00100000:3.0:1790710877.641118:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d03fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+51:11566:x1877696158194304:12345-192.168.206.46@tcp:101:lfs.0 Request processed in 337us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710877.641163:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 202 00000100:00100000:2.0:1790710877.645541:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710877.645664:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158194560 00000100:00100000:1.0:1790710877.645675:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158194560 00000100:00100000:1.0:1790710877.645743:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 57 00000100:00100000:1.0:1790710877.645754:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d03fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+51:11566:x1877696158194560:12345-192.168.206.46@tcp:35:lfs.0 00000100:00100000:1.0:1790710877.646531:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d03fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+52:11566:x1877696158194560:12345-192.168.206.46@tcp:35:lfs.0 Request processed in 773us (996us total) trans 4294967496 rc 0/0 00000100:00100000:1.0:1790710877.646542:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 57 00010000:00010000:2.0:1790710877.704402:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790710877.734959:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710877.735168:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158194688 00000100:00100000:1.0:1790710877.735182:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158194688 00000100:00100000:1.0:1790710877.735257:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 203 00000100:00100000:1.0:1790710877.735270:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff044700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+52:11576:x1877696158194688:12345-192.168.206.46@tcp:34:lfs.0 00010000:00010000:1.0:1790710877.735377:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571b18 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.735398:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571b18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.735411:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571b18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.735428:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480200/0xcbad34b281571b1f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.735436:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480200/0xcbad34b281571b1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.735442:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480200/0xcbad34b281571b1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.735564:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571b26 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.735573:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571b26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.735579:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571b26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790710877.735627:0:5846:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571b26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.735641:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571b18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.735648:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571b18 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.735654:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571b18 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.735660:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c6480c00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1790710877.735664:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571b18 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.735672:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571b18 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.735685:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c51cca25000) 00010000:00010000:1.0:1790710877.735688:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790710877.735692:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571b18 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.735706:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571b18 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.735736:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480200/0xcbad34b281571b1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.735741:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480200/0xcbad34b281571b1f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.735747:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480200/0xcbad34b281571b1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.735751:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c6480200 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1790710877.735753:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480200/0xcbad34b281571b1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.735758:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480200/0xcbad34b281571b1f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.735765:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c51d8e33a00) 00010000:00010000:1.0:1790710877.735767:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790710877.735770:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480200/0xcbad34b281571b1f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.735775:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480200/0xcbad34b281571b1f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.735790:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571b26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.735795:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571b26 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.735806:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571b26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.735812:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c6481000 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1790710877.735815:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571b26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.735821:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571b26 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.735828:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c51c2c2e800) 00010000:00010000:1.0:1790710877.735830:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790710877.735833:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571b26 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.735839:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571b26 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710877.735940:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff044700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+52:11576:x1877696158194688:12345-192.168.206.46@tcp:34:lfs.0 Request processed in 672us (1004us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710877.736772:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 203 00000100:00100000:2.0:1790710877.773621:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710877.773734:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158194944 00000100:00100000:3.0:1790710877.773749:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158194944 00000100:00100000:3.0:1790710877.773825:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 204 00000100:00100000:3.0:1790710877.773837:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d03fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+52:11579:x1877696158194944:12345-192.168.206.46@tcp:101:lfs.0 00010000:00010000:3.0:1790710877.773866:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790710877.773892:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b281571b2d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b057000742 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.774110:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046200/0xcbad34b281571b34 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.774170:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046200/0xcbad34b281571b34 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.774184:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046200/0xcbad34b281571b34 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.774219:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b281571b3b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.774227:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b281571b3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.774234:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b281571b3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.774382:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b281571b42 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.774392:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b281571b42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.774399:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b281571b42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790710877.774411:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1790710877.774526:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046200/0xcbad34b281571b34 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.774535:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046200/0xcbad34b281571b34 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.774541:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046200/0xcbad34b281571b34 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.774547:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c8046200 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1790710877.774552:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046200/0xcbad34b281571b34 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.774571:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046200/0xcbad34b281571b34 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.774585:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c51cca25000) 00010000:00010000:3.0:1790710877.774588:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790710877.774594:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046200/0xcbad34b281571b34 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.774601:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046200/0xcbad34b281571b34 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.774617:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b281571b3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.774623:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b281571b3b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.774629:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b281571b3b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.774634:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c8046800 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1790710877.774637:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b281571b3b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.774644:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b281571b3b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.774650:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c51c2c2e400) 00010000:00010000:3.0:1790710877.774653:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790710877.774655:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b281571b3b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.774671:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b281571b3b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.775904:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b281571b2d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000742 expref: 55 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.775935:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b281571b42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000742 expref: 54 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.775955:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c51c2c2e800) 00010000:00010000:3.0:1790710877.775958:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790710877.775961:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c8047a00, rc 0) 00000100:00100000:3.0:1790710877.776069:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d03fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+54:11579:x1877696158194944:12345-192.168.206.46@tcp:101:lfs.0 Request processed in 2233us (2460us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1790710877.776079:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 204 00000100:00100000:3.0:1790710877.779268:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710877.779856:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158195072 00000100:00100000:0.0:1790710877.779871:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158195072 00000100:00100000:0.0:1790710877.780172:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 205 00000100:00100000:0.0:1790710877.780185:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f498e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+54:11579:x1877696158195072:12345-192.168.206.46@tcp:54:lfs.0 00010000:00010000:0.0:1790710877.780273:0:8060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243a400/0xcbad34b281571b50 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.780312:0:8060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243a400/0xcbad34b281571b50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.780337:0:8060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243a400/0xcbad34b281571b50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.780370:0:8060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243a400/0xcbad34b281571b50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.780377:0:8060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243a400/0xcbad34b281571b50 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.780385:0:8060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243a400/0xcbad34b281571b50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.780391:0:8060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c243a400 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1790710877.780396:0:8060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243a400/0xcbad34b281571b50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.780404:0:8060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243a400/0xcbad34b281571b50 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.780418:0:8060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c51c2c2e800) 00010000:00010000:0.0:1790710877.780422:0:8060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790710877.780428:0:8060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243a400/0xcbad34b281571b50 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.780435:0:8060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243a400/0xcbad34b281571b50 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710877.780530:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f498e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+54:11579:x1877696158195072:12345-192.168.206.46@tcp:54:lfs.0 Request processed in 347us (1274us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710877.780545:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 205 00000100:00100000:3.0:1790710877.782829:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710877.783269:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158195328 00000100:00100000:2.0:1790710877.783281:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158195328 00000100:00100000:2.0:1790710877.783355:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 58 00000100:00100000:2.0:1790710877.783367:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f498ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+54:11579:x1877696158195328:12345-192.168.206.46@tcp:35:lfs.0 00000100:00100000:2.0:1790710877.783655:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f498ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+55:11579:x1877696158195328:12345-192.168.206.46@tcp:35:lfs.0 Request processed in 289us (836us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1790710877.783664:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 58 00000100:00100000:2.0:1790710877.849285:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710877.849404:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158195584 00000100:00100000:3.0:1790710877.849418:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158195584 00000100:00100000:3.0:1790710877.849497:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 206 00000100:00100000:3.0:1790710877.849508:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d03faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+55:11589:x1877696158195584:12345-192.168.206.46@tcp:101:bash.0 00010000:00010000:3.0:1790710877.849545:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790710877.849549:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1790710877.849586:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b600/0xcbad34b281571ad2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000726 expref: 55 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.849610:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c51cca25000) 00010000:00010000:3.0:1790710877.849633:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790710877.849652:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b281571b57 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b057000749 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.850088:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b281571b5e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.850119:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b281571b42 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000742 expref: 55 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.850414:0:5847:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b281571b5e lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.850570:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b281571b42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.46@tcp remote: 0x566877b057000742 expref: 55 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710877.850590:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b281571b42 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000742 expref: 55 pid: 5845 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710877.850607:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51d03f8000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1877696177057536:192.168.206.46@tcp:104: 00000100:00100000:2.0:1790710877.850906:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f4013b40 going to sleep for 11 seconds 00000100:00100000:2.0:1790710877.864315:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710877.864466:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51d03f8000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1877696177057536:192.168.206.46@tcp:104: 00010000:00010000:0.0:1790710877.864505:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b281571b5e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710877.864624:0:8449:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158195712 00000100:00100000:3.0:1790710877.864634:0:8449:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158195712 00010000:00010000:3.0:1790710877.864696:0:8449:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b281571b42 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000742 expref: 56 pid: 5845 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710877.864745:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 76 00000100:00100000:3.0:1790710877.864756:0:8449:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d03f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+56:2358:x1877696158195712:12345-192.168.206.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790710877.864775:0:8449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790710877.864784:0:8449:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b281571b42 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000742 expref: 56 pid: 5845 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.864798:0:8449:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b281571b42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000742 expref: 56 pid: 5845 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.864825:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b281571b42 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000742 expref: 56 pid: 5845 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.864869:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c51c2c2e800) 00010000:00010000:3.0:1790710877.864875:0:8449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b281571b5e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.864887:0:8449:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b281571b5e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.864896:0:8449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b281571b5e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.864932:0:8449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790710877.865018:0:8449:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d03f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+55:2358:x1877696158195712:12345-192.168.206.46@tcp:103:ldlm_bl.0 Request processed in 262us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710877.865026:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 76 00010000:00010000:0.0:1790710877.865315:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b281571b5e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.865334:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b281571b5e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790710877.865359:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1790710877.865547:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b281571b57 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000749 expref: 56 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.865569:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b281571b5e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000749 expref: 55 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.865577:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c51c2c2e800) 00010000:00010000:0.0:1790710877.865580:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790710877.865583:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c8046800, rc 0) 00000100:00100000:0.0:1790710877.865620:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d03faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+55:11589:x1877696158195584:12345-192.168.206.46@tcp:101:bash.0 Request processed in 16114us (16348us total) trans 4294967499 rc 0/0 00000100:00100000:0.0:1790710877.865628:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 206 00000100:00100000:1.0:1790710877.873970:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710877.874180:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158195968 00000100:00100000:0.0:1790710877.874194:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158195968 00000100:00100000:0.0:1790710877.874269:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 207 00000100:00100000:0.0:1790710877.874281:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4cf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+55:11589:x1877696158195968:12345-192.168.206.46@tcp:36:bash.0 00010000:00010000:0.0:1790710877.874663:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243a400/0xcbad34b281571b6c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.874685:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243a400/0xcbad34b281571b6c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.874698:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243a400/0xcbad34b281571b6c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790710877.874832:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967500 00000004:00010000:0.0:1790710877.874864:0:5846:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000a53d15d3 reply state 000000006a518be9 transno 4294967501 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243a400/0xcbad34b281571b6c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710877.874874:0:5846:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790710877.875252:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4cf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+58:11589:x1877696158195968:12345-192.168.206.46@tcp:36:bash.0 Request processed in 971us (1308us total) trans 4294967501 rc 0/0 00000100:00100000:0.0:1790710877.875261:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 207 00000020:00080000:0.0:1790710877.875267:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1790710877.877788:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243a400/0xcbad34b281571b6c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.877811:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243a400/0xcbad34b281571b6c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.877820:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243a400/0xcbad34b281571b6c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.877852:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c243a400 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1790710877.877858:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243a400/0xcbad34b281571b6c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.877867:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243a400/0xcbad34b281571b6c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.877888:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c51c2c2e800) 00010000:00010000:1.0:1790710877.877892:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790710877.877897:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243a400/0xcbad34b281571b6c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710877.877903:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243a400/0xcbad34b281571b6c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710877.878774:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710877.878894:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158196096 00000100:00100000:3.0:1790710877.878907:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158196096 00000100:00100000:3.0:1790710877.878982:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 208 00000100:00100000:3.0:1790710877.878994:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4cf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+57:11589:x1877696158196096:12345-192.168.206.46@tcp:101:bash.0 00010000:00010000:3.0:1790710877.879022:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790710877.879044:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b281571b73 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b057000750 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.879190:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046200/0xcbad34b281571b7a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.879400:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b281571b5e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000749 expref: 58 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.879429:0:5845:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046200/0xcbad34b281571b7a lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.879472:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b281571b5e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.46@tcp remote: 0x566877b057000749 expref: 58 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.879488:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b281571b5e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000749 expref: 58 pid: 5847 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710877.879503:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f498f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1877696177057664:192.168.206.46@tcp:104: 00000100:00100000:3.0:1790710877.879615:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c3f8c000 going to sleep for 11 seconds 00000100:00100000:2.0:1790710877.882975:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710877.883222:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158196224 00000100:00100000:0.0:1790710877.883234:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158196224 00010000:00010000:0.0:1790710877.883285:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b281571b5e lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000749 expref: 59 pid: 5847 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710877.883335:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 77 00000100:00100000:0.0:1790710877.883346:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d03f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+59:2359:x1877696158196224:12345-192.168.206.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790710877.883366:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790710877.883374:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b281571b5e lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000749 expref: 59 pid: 5847 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.883406:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b281571b5e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000749 expref: 59 pid: 5847 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.883439:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c51c2c2e800) 00010000:00010000:0.0:1790710877.883445:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046200/0xcbad34b281571b7a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.883457:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046200/0xcbad34b281571b7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.883465:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046200/0xcbad34b281571b7a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.883487:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790710877.883560:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d03f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+59:2359:x1877696158196224:12345-192.168.206.46@tcp:103:ldlm_bl.0 Request processed in 215us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710877.883569:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 77 00010000:00010000:3.0:1790710877.884193:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b281571b5e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000749 expref: 58 pid: 5847 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710877.884294:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f498f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1877696177057664:192.168.206.46@tcp:104: 00010000:00010000:3.0:1790710877.884321:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046200/0xcbad34b281571b7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.884332:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046200/0xcbad34b281571b7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.884339:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046200/0xcbad34b281571b7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790710877.884398:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1790710877.884404:0:5845:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790710877.884429:0:5845:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046200/0xcbad34b281571b7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.884483:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b281571b73 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000750 expref: 58 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.884499:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046200/0xcbad34b281571b7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000750 expref: 57 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.884509:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c51c2c2e800) 00010000:00010000:3.0:1790710877.884512:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790710877.884515:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c8046200, rc 0) 00000100:00100000:3.0:1790710877.884574:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4cf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+57:11589:x1877696158196096:12345-192.168.206.46@tcp:101:bash.0 Request processed in 5582us (5808us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710877.884582:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 208 00000100:00100000:2.0:1790710877.888262:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710877.888570:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158196480 00000100:00100000:1.0:1790710877.888582:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158196480 00000100:00100000:1.0:1790710877.888692:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 59 00000100:00100000:1.0:1790710877.888704:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d03f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+57:11589:x1877696158196480:12345-192.168.206.46@tcp:35:bash.0 00000100:00100000:1.0:1790710877.889036:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d03f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+58:11589:x1877696158196480:12345-192.168.206.46@tcp:35:bash.0 Request processed in 333us (909us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1790710877.889044:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 59 00000100:00100000:2.0:1790710877.938227:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710877.938343:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158196608 00000100:00100000:0.0:1790710877.938355:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158196608 00000100:00100000:0.0:1790710877.938420:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 209 00000100:00100000:0.0:1790710877.938429:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d03f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+58:11595:x1877696158196608:12345-192.168.206.46@tcp:101:lfs.0 00010000:00010000:0.0:1790710877.938460:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790710877.938484:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b000/0xcbad34b281571b81 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b057000757 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.938578:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ba00/0xcbad34b281571b88 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.938619:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ba00/0xcbad34b281571b88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.938633:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ba00/0xcbad34b281571b88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790710877.938677:0:5846:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1790710877.938682:0:5846:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790710877.938702:0:5846:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ba00/0xcbad34b281571b88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.938733:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b000/0xcbad34b281571b81 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000757 expref: 60 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.938753:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ba00/0xcbad34b281571b88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000757 expref: 59 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.938764:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c51cca25000) 00010000:00010000:0.0:1790710877.938767:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790710877.938771:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c243ba00, rc 0) 00000100:00100000:0.0:1790710877.938854:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d03f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+59:11595:x1877696158196608:12345-192.168.206.46@tcp:101:lfs.0 Request processed in 425us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710877.938862:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 209 00000100:00100000:2.0:1790710877.943644:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710877.943747:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158196736 00000100:00100000:0.0:1790710877.943761:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158196736 00000100:00100000:0.0:1790710877.943835:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 210 00000100:00100000:0.0:1790710877.943847:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d03fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+59:11595:x1877696158196736:12345-192.168.206.46@tcp:101:lfs.0 00010000:00010000:0.0:1790710877.943874:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790710877.943918:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243bc00/0xcbad34b281571b8f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b05700075e expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.944001:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ae00/0xcbad34b281571b96 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.944019:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ae00/0xcbad34b281571b96 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.944032:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ae00/0xcbad34b281571b96 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.944049:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243be00/0xcbad34b281571b9d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.944056:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243be00/0xcbad34b281571b9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.944062:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243be00/0xcbad34b281571b9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.944212:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b281571ba4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.944222:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b281571ba4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.944229:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b281571ba4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790710877.944271:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1790710877.944276:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790710877.944297:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b281571ba4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.944320:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b281571ba4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.944339:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ae00/0xcbad34b281571b96 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.944346:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ae00/0xcbad34b281571b96 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.944352:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ae00/0xcbad34b281571b96 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.944358:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c243ae00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1790710877.944364:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ae00/0xcbad34b281571b96 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.944372:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ae00/0xcbad34b281571b96 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.944385:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c51cca25000) 00010000:00010000:0.0:1790710877.944389:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790710877.944395:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ae00/0xcbad34b281571b96 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.944402:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ae00/0xcbad34b281571b96 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.944416:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243be00/0xcbad34b281571b9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.944421:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243be00/0xcbad34b281571b9d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.944433:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243be00/0xcbad34b281571b9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.944438:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c243be00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1790710877.944441:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243be00/0xcbad34b281571b9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.944447:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243be00/0xcbad34b281571b9d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.944454:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c51e4efb000) 00010000:00010000:0.0:1790710877.944456:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790710877.944459:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243be00/0xcbad34b281571b9d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.944464:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243be00/0xcbad34b281571b9d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.944507:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243bc00/0xcbad34b281571b8f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700075e expref: 61 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.944521:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b281571ba4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700075e expref: 60 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.944528:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c51c2c2e800) 00010000:00010000:0.0:1790710877.944530:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790710877.944533:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c243b800, rc 0) 00000100:00100000:0.0:1790710877.944615:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d03fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+60:11595:x1877696158196736:12345-192.168.206.46@tcp:101:lfs.0 Request processed in 770us (986us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710877.944635:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 210 00000100:00100000:3.0:1790710877.949779:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710877.949982:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158196992 00000100:00100000:0.0:1790710877.949995:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158196992 00000100:00100000:0.0:1790710877.950061:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 211 00000100:00100000:0.0:1790710877.950071:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f498f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+60:11595:x1877696158196992:12345-192.168.206.46@tcp:101:lfs.0 00010000:00010000:0.0:1790710877.950108:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790710877.950149:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b000/0xcbad34b281571bab lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b057000765 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.950272:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243a400/0xcbad34b281571bb2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.950288:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046200/0xcbad34b281571b7a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000750 expref: 61 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.950297:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b281571ba4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700075e expref: 61 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.950305:0:5846:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243a400/0xcbad34b281571bb2 lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.950359:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b281571ba4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.46@tcp remote: 0x566877b05700075e expref: 61 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.950374:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b281571ba4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.46@tcp remote: 0x566877b05700075e expref: 61 pid: 5847 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710877.950388:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51ff045f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1877696177057792:192.168.206.46@tcp:104: 00010000:00010000:0.0:1790710877.950514:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046200/0xcbad34b281571b7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.46@tcp remote: 0x566877b057000750 expref: 61 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.950524:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046200/0xcbad34b281571b7a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000750 expref: 61 pid: 5845 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710877.950533:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51ff044a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1877696177057920:192.168.206.46@tcp:104: 00000100:00100000:0.0:1790710877.950552:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c78e1d80 going to sleep for 11 seconds 00000100:00100000:0.0:1790710877.953401:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51ff045f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1877696177057792:192.168.206.46@tcp:104: 00000100:00100000:0.0:1790710877.953422:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51ff044a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1877696177057920:192.168.206.46@tcp:104: 00010000:00010000:0.0:1790710877.953455:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243a400/0xcbad34b281571bb2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710877.954583:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710877.954626:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710877.954704:0:8449:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158197248 00000100:00100000:0.0:1790710877.954716:0:8449:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158197248 00010000:00010000:0.0:1790710877.954762:0:8449:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046200/0xcbad34b281571b7a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000750 expref: 62 pid: 5845 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710877.954812:0:8449:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158197120 00000100:00100000:0.0:1790710877.954816:0:8449:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158197120 00010000:00010000:0.0:1790710877.954829:0:8449:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b281571ba4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.46@tcp remote: 0x566877b05700075e expref: 63 pid: 5847 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710877.954862:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 78 00000100:00100000:0.0:1790710877.954874:0:8449:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f498e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+63:2358:x1877696158197248:12345-192.168.206.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790710877.954894:0:8449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790710877.954924:0:8449:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046200/0xcbad34b281571b7a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000750 expref: 63 pid: 5845 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.954936:0:8449:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046200/0xcbad34b281571b7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000750 expref: 63 pid: 5845 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.954971:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046200/0xcbad34b281571b7a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000750 expref: 63 pid: 5845 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.954992:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c51c2c2e800) 00010000:00010000:0.0:1790710877.954998:0:8449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243a400/0xcbad34b281571bb2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.955008:0:8449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243a400/0xcbad34b281571bb2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.955015:0:8449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790710877.955081:0:8449:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f498e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+62:2358:x1877696158197248:12345-192.168.206.46@tcp:103:ldlm_bl.0 Request processed in 209us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710877.955089:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 78 00000100:00100000:0.0:1790710877.955172:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 79 00000100:00100000:0.0:1790710877.955180:0:8449:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f498f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+61:2358:x1877696158197120:12345-192.168.206.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790710877.955188:0:8449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790710877.955193:0:8449:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b281571ba4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.46@tcp remote: 0x566877b05700075e expref: 61 pid: 5847 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.955203:0:8449:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b281571ba4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.46@tcp remote: 0x566877b05700075e expref: 61 pid: 5847 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.955227:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b281571ba4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.46@tcp remote: 0x566877b05700075e expref: 61 pid: 5847 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.955238:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c51c2c2e800) 00010000:00010000:0.0:1790710877.955241:0:8449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243a400/0xcbad34b281571bb2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.955250:0:8449:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243a400/0xcbad34b281571bb2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.955259:0:8449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243a400/0xcbad34b281571bb2 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.955285:0:8449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790710877.955305:0:8449:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f498f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+60:2358:x1877696158197120:12345-192.168.206.46@tcp:103:ldlm_bl.0 Request processed in 126us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710877.955311:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 79 00010000:00010000:0.0:1790710877.955337:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243a400/0xcbad34b281571bb2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.955345:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243a400/0xcbad34b281571bb2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790710877.955367:0:5846:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1790710877.955542:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b000/0xcbad34b281571bab lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000765 expref: 61 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.955559:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243a400/0xcbad34b281571bb2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000765 expref: 60 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.955578:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c51c2c2e800) 00010000:00010000:0.0:1790710877.955581:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790710877.955584:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c243a400, rc 0) 00000100:00100000:0.0:1790710877.955611:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f498f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+60:11595:x1877696158196992:12345-192.168.206.46@tcp:101:lfs.0 Request processed in 5542us (5845us total) trans 4294967503 rc 0/0 00000100:00100000:0.0:1790710877.955619:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 211 00000100:00100000:2.0:1790710877.958646:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710877.959111:0:8449:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158197504 00000100:00100000:0.0:1790710877.959152:0:8449:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158197504 00000100:00100000:0.0:1790710877.959232:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 16 00000100:00100000:0.0:1790710877.959244:0:8449:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d03f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+60:11595:x1877696158197504:12345-192.168.206.46@tcp:103:lfs.0 00010000:00010000:0.0:1790710877.959264:0:8449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790710877.959297:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b281571b11 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700073b expref: 60 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.959319:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c51c2c2e800) 00010000:00010000:0.0:1790710877.959336:0:8449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790710877.959408:0:8449:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d03f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+59:11595:x1877696158197504:12345-192.168.206.46@tcp:103:lfs.0 Request processed in 166us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710877.959415:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 16 00000100:00100000:1.0:1790710877.966789:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710877.966922:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158197632 00000100:00100000:0.0:1790710877.966935:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158197632 00000100:00100000:0.0:1790710877.967114:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 212 00000100:00100000:0.0:1790710877.967154:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4cf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+59:11595:x1877696158197632:12345-192.168.206.46@tcp:58:lfs.0 00010000:00010000:0.0:1790710877.967283:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243bc00/0xcbad34b281571bc0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.967326:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243bc00/0xcbad34b281571bc0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710877.967340:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243bc00/0xcbad34b281571bc0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790710877.967515:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1790710877.967670:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4cf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+59:11595:x1877696158197632:12345-192.168.206.46@tcp:58:lfs.0 Request processed in 544us (892us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710877.967679:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 212 00000100:00100000:2.0:1790710877.971360:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710877.971477:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158197760 00000100:00100000:3.0:1790710877.971491:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158197760 00000100:00100000:3.0:1790710877.971557:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 213 00000100:00100000:3.0:1790710877.971568:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d03f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+59:11595:x1877696158197760:12345-192.168.206.46@tcp:101:lfs.0 00010000:00010000:3.0:1790710877.971609:0:8060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790710877.971641:0:8060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b281571bc7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b05700076c expref: -99 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.971716:0:8060:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243bc00/0xcbad34b281571bc0 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.971729:0:8060:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b281571bc7 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700076c expref: 60 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.971767:0:8060:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243bc00/0xcbad34b281571bc0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.971785:0:8060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b281571bc7 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700076c expref: 60 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.971802:0:8060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c51c2c2e800) 00010000:00010000:3.0:1790710877.971806:0:8060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790710877.971811:0:8060:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b281571bc7 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700076c expref: 60 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710877.971819:0:8060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c8047a00, rc 0) 00000100:00100000:3.0:1790710877.971908:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d03f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+60:11595:x1877696158197760:12345-192.168.206.46@tcp:101:lfs.0 Request processed in 341us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710877.971915:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 213 00000001:00080000:0.0:1790710877.991060:0:6720:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:0.0:1790710877.991101:0:6720:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000040:00080000:2.0:1790710878.600302:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790710878.600311:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790710878.600604:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1790710878.600611:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790710878.600728:0:11676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51d03fb100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11676:1877696177058048:192.168.206.46@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790710878.600829:0:11676:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f4013840 going to sleep for 11 seconds 00000100:00100000:2.0:1790710878.604629:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710878.605181:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158197888 00000100:00100000:3.0:1790710878.605195:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158197888 00000100:00100000:3.0:1790710878.605296:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 214 00000100:00100000:3.0:1790710878.605309:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d03f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+61:11596:x1877696158197888:12345-192.168.206.46@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1790710878.605354:0:5845:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1790710878.605499:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d03f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+61:11596:x1877696158197888:12345-192.168.206.46@tcp:53:lhsmtool_posix.0 Request processed in 192us (881us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710878.605507:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 214 00000100:00080000:1.0:1790710878.606676:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790710878.609864:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710878.610043:0:11676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51d03fb100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11676:1877696177058048:192.168.206.46@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790710878.611037:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158198016 00000100:00100000:1.0:1790710878.611051:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158198016 00000100:00100000:1.0:1790710878.611151:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 215 00000100:00100000:1.0:1790710878.611180:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f498d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+60:11596:x1877696158198016:12345-192.168.206.46@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1790710878.611273:0:8060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571bce lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.611295:0:8060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571bce lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.611309:0:8060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571bce lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.611454:0:8060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481200/0xcbad34b281571bd5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.611465:0:8060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481200/0xcbad34b281571bd5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.611472:0:8060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481200/0xcbad34b281571bd5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.611500:0:8060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b281571bdc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.611509:0:8060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b281571bdc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.611516:0:8060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b281571bdc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790710878.611563:0:8060:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1790710878.611568:0:8060:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790710878.611585:0:8060:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b281571bdc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.611609:0:8060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571bce lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.611616:0:8060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571bce lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.611624:0:8060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571bce lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.611630:0:8060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c6480c00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1790710878.611635:0:8060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571bce lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.611643:0:8060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571bce lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.611657:0:8060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c51cca25300) 00010000:00010000:1.0:1790710878.611660:0:8060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790710878.611665:0:8060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571bce lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.611673:0:8060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571bce lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.611687:0:8060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481200/0xcbad34b281571bd5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.611694:0:8060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481200/0xcbad34b281571bd5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.611699:0:8060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481200/0xcbad34b281571bd5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.615015:0:8060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c6481200 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1790710878.615024:0:8060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481200/0xcbad34b281571bd5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.615037:0:8060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481200/0xcbad34b281571bd5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.615058:0:8060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9c51d8e33100) 00010000:00010000:1.0:1790710878.615061:0:8060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790710878.615072:0:8060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481200/0xcbad34b281571bd5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.615080:0:8060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481200/0xcbad34b281571bd5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.615146:0:8060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b281571bdc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.615153:0:8060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b281571bdc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.615160:0:8060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b281571bdc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.615165:0:8060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c6481c00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1790710878.615169:0:8060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b281571bdc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.615175:0:8060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b281571bdc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.615213:0:8060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c51c2c2e800) 00010000:00010000:1.0:1790710878.615216:0:8060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790710878.615220:0:8060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b281571bdc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.615227:0:8060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b281571bdc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710878.615356:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f498d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+60:11596:x1877696158198016:12345-192.168.206.46@tcp:34:lhsmtool_posix.0 Request processed in 4172us (5545us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710878.615369:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 215 00000100:00100000:3.0:1790710878.621063:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710878.622451:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158198272 00000100:00100000:1.0:1790710878.622468:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158198272 00000100:00100000:1.0:1790710878.622585:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 216 00000100:00100000:1.0:1790710878.622597:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f498c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+60:11596:x1877696158198272:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790710878.622624:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790710878.622648:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481200/0xcbad34b281571be3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b057000773 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.622783:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571bea lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.622802:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571bea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.622816:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571bea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790710878.622842:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1790710878.622983:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571bea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.622992:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571bea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.623000:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571bea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.623007:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c6480c00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1790710878.623011:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571bea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.623019:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571bea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.623032:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c51c2c2e800) 00010000:00010000:1.0:1790710878.623036:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790710878.623041:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571bea lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.623047:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571bea lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.623104:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481200/0xcbad34b281571be3 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000773 expref: 62 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.623116:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c51cca25300) 00010000:00010000:1.0:1790710878.623118:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790710878.623122:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481200/0xcbad34b281571be3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000773 expref: 62 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.623183:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c6481200, rc 0) 00000100:00100000:1.0:1790710878.623268:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f498c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+61:11596:x1877696158198272:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 Request processed in 674us (2219us total) trans 4294967504 rc 301/301 00000100:00100000:1.0:1790710878.623278:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 216 00000100:00100000:2.0:1790710878.629481:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710878.629596:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158198400 00000100:00100000:0.0:1790710878.629610:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158198400 00000100:00100000:0.0:1790710878.629674:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 217 00000100:00100000:0.0:1790710878.629686:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d03f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+61:11596:x1877696158198400:12345-192.168.206.46@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1790710878.629736:0:5846:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1790710878.629881:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d03f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+61:11596:x1877696158198400:12345-192.168.206.46@tcp:53:lhsmtool_posix.0 Request processed in 197us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710878.629889:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 217 00000100:00100000:3.0:1790710878.632682:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710878.632775:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158198656 00000100:00100000:2.0:1790710878.632787:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158198656 00000100:00100000:2.0:1790710878.632866:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 218 00000100:00100000:2.0:1790710878.632879:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff123480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+61:11596:x1877696158198656:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790710878.632907:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790710878.632911:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1790710878.632943:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ba00/0xcbad34b281571b88 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000757 expref: 61 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710878.632967:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c51cca25000) 00010000:00010000:2.0:1790710878.632973:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790710878.632989:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9000/0xcbad34b281571bf8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b05700077a expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790710878.633567:0:5847:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:2.0:1790710878.633785:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8a00/0xcbad34b281571bff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710878.633803:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8a00/0xcbad34b281571bff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710878.633817:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8a00/0xcbad34b281571bff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710878.633905:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9000/0xcbad34b281571bf8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700077a expref: 63 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710878.633924:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8a00/0xcbad34b281571bff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700077a expref: 62 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710878.633934:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c51cca25a00) 00010000:00010000:2.0:1790710878.633937:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790710878.633941:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51f43f8a00, rc 0) 00000100:00100000:2.0:1790710878.634032:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff123480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+62:11596:x1877696158198656:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 Request processed in 1155us (1363us total) trans 4294967505 rc 0/0 00000100:00100000:2.0:1790710878.634042:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 218 00000100:00100000:3.0:1790710878.637263:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710878.637570:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158198912 00000100:00100000:0.0:1790710878.637583:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158198912 00000100:00100000:0.0:1790710878.637730:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 219 00000100:00100000:0.0:1790710878.637741:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff122680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+62:11596:x1877696158198912:12345-192.168.206.46@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790710878.638294:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790710878.638344:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8a00/0xcbad34b281571bff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700077a expref: 62 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710878.638368:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c51cca25a00) 00010000:00010000:0.0:1790710878.638515:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790710878.638544:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b000/0xcbad34b281571c0d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710878.638561:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b000/0xcbad34b281571c0d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710878.638572:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b000/0xcbad34b281571c0d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710878.640996:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b281571c14 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x584ac7c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710878.641018:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b281571c14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x584ac7c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710878.641030:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b281571c14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x584ac7c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710878.641115:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b000/0xcbad34b281571c0d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710878.641124:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b000/0xcbad34b281571c0d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710878.641147:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b000/0xcbad34b281571c0d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710878.641154:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c243b000 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1790710878.641172:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b000/0xcbad34b281571c0d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710878.641181:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b000/0xcbad34b281571c0d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710878.641194:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c51cca25000) 00010000:00010000:0.0:1790710878.641198:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790710878.641203:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b000/0xcbad34b281571c0d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710878.641209:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b000/0xcbad34b281571c0d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710878.641223:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b281571c14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x584ac7c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710878.641393:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b281571c14 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x584ac7c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710878.641399:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b281571c14 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x584ac7c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710878.641405:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c243b800 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1790710878.641408:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b281571c14 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x584ac7c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710878.641414:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b281571c14 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x584ac7c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710878.641423:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x584ac7c1 (ffff9c51e4efb200) 00010000:00010000:0.0:1790710878.641425:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790710878.641438:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b281571c14 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x584ac7c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710878.641444:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b281571c14 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x584ac7c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710878.641553:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff122680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+61:11596:x1877696158198912:12345-192.168.206.46@tcp:36:lhsmtool_posix.0 Request processed in 3809us (4298us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790710878.641562:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 219 00000100:00100000:3.0:1790710878.645275:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710878.645443:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158199040 00000100:00100000:2.0:1790710878.645593:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158199040 00000100:00100000:2.0:1790710878.645749:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 220 00000100:00100000:2.0:1790710878.645760:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff123800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+61:11596:x1877696158199040:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790710878.645789:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790710878.646239:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9000/0xcbad34b281571c1b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b057000781 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710878.646294:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8200/0xcbad34b281571c22 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710878.646309:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8200/0xcbad34b281571c22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710878.646322:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8200/0xcbad34b281571c22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710878.647561:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9000/0xcbad34b281571c1b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000781 expref: 63 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710878.647597:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8200/0xcbad34b281571c22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000781 expref: 62 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710878.647607:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c51cca25200) 00010000:00010000:2.0:1790710878.647619:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790710878.647623:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51f43f8200, rc 0) 00000100:00100000:2.0:1790710878.647727:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff123800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+62:11596:x1877696158199040:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 Request processed in 1968us (2913us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710878.647737:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 220 00000100:00100000:3.0:1790710878.651583:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710878.652930:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158199296 00000100:00100000:1.0:1790710878.653009:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158199296 00000100:00100000:1.0:1790710878.653264:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 221 00000100:00100000:1.0:1790710878.653278:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff122300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+62:11596:x1877696158199296:12345-192.168.206.46@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790710878.653530:0:8060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571c29 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.653557:0:8060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571c29 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.653572:0:8060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571c29 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790710878.654590:0:8060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:1.0:1790710878.654606:0:8060:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 355991477930ns, next at 356991474992ns, rc = 0 00000004:00010000:1.0:1790710878.654790:0:8060:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000009c949f54 reply state 00000000ac9495f4 transno 4294967506 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571c29 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710878.654801:0:8060:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790710878.655309:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff122300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+64:11596:x1877696158199296:12345-192.168.206.46@tcp:36:lhsmtool_posix.0 Request processed in 2028us (3734us total) trans 4294967506 rc 0/0 00000100:00100000:1.0:1790710878.655319:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 221 00010000:00010000:0.0:1790710878.657608:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571c29 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710878.657631:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571c29 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710878.657640:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571c29 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710878.657646:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c6480c00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1790710878.657652:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571c29 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710878.657661:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571c29 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710878.657680:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c51cca25200) 00010000:00010000:0.0:1790710878.657684:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790710878.657689:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571c29 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710878.657696:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571c29 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710878.659061:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710878.659392:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158199424 00000100:00100000:1.0:1790710878.659420:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158199424 00000100:00100000:1.0:1790710878.659492:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 222 00000100:00100000:1.0:1790710878.659504:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff122a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+63:11596:x1877696158199424:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790710878.659537:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790710878.659561:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b281571c30 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b057000788 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.659634:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b281571c30 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000788 expref: 64 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.659649:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b281571c30 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000788 expref: 64 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.659672:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c51cca25200) 00010000:00010000:1.0:1790710878.659675:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790710878.659679:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c6481c00, rc 0) 00000100:00100000:1.0:1790710878.659753:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff122a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+64:11596:x1877696158199424:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 Request processed in 251us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710878.659761:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 222 00000100:00100000:1.0:1790710878.663725:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710878.663910:0:12058:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158199552 00000100:00100000:3.0:1790710878.663923:0:12058:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158199552 00000100:00100000:3.0:1790710878.664003:0:12058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 62 00000100:00100000:3.0:1790710878.664014:0:12058:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4cf2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+9:2359:x1877696158199552:12345-192.168.206.46@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1790710878.664894:0:12058:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4cf2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+10:2359:x1877696158199552:12345-192.168.206.46@tcp:2:lhsmtool_posix.0 Request processed in 875us (1185us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1790710878.664913:0:12058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 62 00000100:00100000:3.0:1790710878.668023:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710878.668252:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158199808 00000100:00100000:1.0:1790710878.668265:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158199808 00000100:00100000:1.0:1790710878.668341:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 60 00000100:00100000:1.0:1790710878.668352:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff120000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+64:11596:x1877696158199808:12345-192.168.206.46@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1790710878.669391:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff120000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+65:11596:x1877696158199808:12345-192.168.206.46@tcp:35:lhsmtool_posix.0 Request processed in 1032us (1372us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1790710878.669403:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 60 00000100:00100000:2.0:1790710878.673264:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710878.673447:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158200064 00000100:00100000:0.0:1790710878.673460:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158200064 00000100:00100000:0.0:1790710878.673535:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 223 00000100:00100000:0.0:1790710878.673546:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d03fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+65:11596:x1877696158200064:12345-192.168.206.46@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1790710878.673692:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d03fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+65:11596:x1877696158200064:12345-192.168.206.46@tcp:57:lhsmtool_posix.0 Request processed in 146us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710878.673700:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 223 00000100:00100000:1.0:1790710878.676419:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710878.676501:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158200192 00000100:00100000:3.0:1790710878.676515:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158200192 00000100:00100000:3.0:1790710878.676633:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 224 00000100:00100000:3.0:1790710878.676643:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+65:11596:x1877696158200192:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790710878.676670:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790710878.676695:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b281571c37 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b05700078f expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710878.676797:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b281571c3e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710878.676816:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b281571c3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710878.676837:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b281571c3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790710878.676903:0:5845:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790710878.676926:0:5845:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b281571c3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710878.676968:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046800/0xcbad34b281571c37 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700078f expref: 67 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710878.676989:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b281571c3e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700078f expref: 66 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710878.676999:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c51cca25200) 00010000:00010000:3.0:1790710878.677003:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1790710878.677006:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c8047800, rc 0) 00000100:00100000:3.0:1790710878.677084:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+66:11596:x1877696158200192:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 Request processed in 442us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710878.677105:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 224 00000100:00100000:3.0:1790710878.686503:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710878.686620:0:6696:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158200320 00000100:00100000:2.0:1790710878.686633:0:6696:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158200320 00000100:00100000:2.0:1790710878.686798:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 63 00000100:00100000:2.0:1790710878.686811:0:6696:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff121c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+10:2358:x1877696158200320:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790710878.686835:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790710878.686861:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f4d68960/0xcbad34b281571c45 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b057000796 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790710878.686895:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abc145e, blocks: 0x1 00010000:00010000:2.0:1790710878.686919:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=356s v=(0 0) 00010000:00010000:2.0:1790710878.686924:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790710878.686936:0:6696:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4d68960/0xcbad34b281571c45 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000796 expref: 11 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710878.686987:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f4d68960/0xcbad34b281571c45 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000796 expref: 11 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710878.687005:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51f43f8c00, rc 0) 00000100:00100000:2.0:1790710878.687081:0:6696:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff121c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+11:2358:x1877696158200320:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 Request processed in 273us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710878.687100:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 63 00000100:00100000:0.0:1790710878.696230:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710878.696375:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158200576 00000100:00100000:1.0:1790710878.696388:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158200576 00000100:00100000:1.0:1790710878.696458:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 225 00000100:00100000:1.0:1790710878.696469:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff044a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+66:11596:x1877696158200576:12345-192.168.206.46@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1790710878.696614:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff044a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+66:11596:x1877696158200576:12345-192.168.206.46@tcp:57:lhsmtool_posix.0 Request processed in 146us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710878.696622:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 225 00000100:00100000:1.0:1790710878.699242:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710878.699384:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158200704 00000100:00100000:2.0:1790710878.699396:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158200704 00000100:00100000:2.0:1790710878.699463:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 64 00000100:00100000:2.0:1790710878.699474:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+11:11596:x1877696158200704:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790710878.699499:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790710878.699521:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cc496669/0xcbad34b281571c4c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b05700079d expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710878.699559:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f4d68960/0xcbad34b281571c45 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000796 expref: 12 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710878.699569:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790710878.699573:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790710878.699580:0:6697:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc496669/0xcbad34b281571c4c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700079d expref: 12 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710878.699619:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f4d68960/0xcbad34b281571c45 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.46@tcp remote: 0x566877b057000796 expref: 12 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710878.699653:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f4d68960/0xcbad34b281571c45 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000796 expref: 12 pid: 6696 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710878.699672:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51d03f8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1877696177058176:192.168.206.46@tcp:104: 00000100:00100000:2.0:1790710878.699776:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f4013180 going to sleep for 11 seconds 00000100:00100000:1.0:1790710878.704495:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51d03f8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1877696177058176:192.168.206.46@tcp:104: 00010000:00010000:1.0:1790710878.704543:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cc496669/0xcbad34b281571c4c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.46@tcp remote: 0x566877b05700079d expref: 12 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.704570:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51f43f9600, rc 0) 00000100:00100000:1.0:1790710878.704647:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+12:11596:x1877696158200704:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 Request processed in 5173us (5420us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710878.704657:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 64 00000100:00100000:0.0:1790710878.713544:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710878.713885:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158200832 00000100:00100000:1.0:1790710878.713898:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158200832 00010000:00010000:1.0:1790710878.713948:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f4d68960/0xcbad34b281571c45 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000796 expref: 12 pid: 6696 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710878.714000:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 80 00000100:00100000:1.0:1790710878.714012:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8e5d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+12:2358:x1877696158200832:12345-192.168.206.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790710878.714032:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790710878.714077:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f4d68960/0xcbad34b281571c45 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000796 expref: 12 pid: 6696 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.714103:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f4d68960/0xcbad34b281571c45 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000796 expref: 12 pid: 6696 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.714176:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f4d68960/0xcbad34b281571c45 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000796 expref: 12 pid: 6696 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.714196:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790710878.714201:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790710878.714212:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cc496669/0xcbad34b281571c4c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.46@tcp remote: 0x566877b05700079d expref: 11 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.714224:0:5829:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc496669/0xcbad34b281571c4c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.46@tcp remote: 0x566877b05700079d expref: 11 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.714269:0:5829:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000cc496669/0xcbad34b281571c4c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.46@tcp remote: 0x566877b05700079d expref: 11 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710878.714284:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9765880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5829:1877696177058304:192.168.206.46@tcp:105: 00000100:00100000:1.0:1790710878.714390:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c1254a80 going to sleep for 11 seconds 00000100:00100000:1.0:1790710878.719302:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9765880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5829:1877696177058304:192.168.206.46@tcp:105: 00010000:00010000:1.0:1790710878.719339:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790710878.719416:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8e5d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+11:2358:x1877696158200832:12345-192.168.206.46@tcp:103:ldlm_bl.0 Request processed in 5405us (5884us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710878.719455:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 80 00000100:00100000:2.0:1790710878.721905:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710878.722030:0:6702:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158200960 00000100:00100000:1.0:1790710878.722044:0:6702:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158200960 00002000:00100000:1.0:1790710878.722124:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff9c51d03fad80 x1877696158200960/t0(0) o4->0ec73bd1-726e-4dc0-8edd-807d3f973d65@192.168.206.46@tcp:379/0 lens 504/0 e 0 to 0 dl 1790710889 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790710878.722184:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c51d03fad80 with x1877696158200960 ext(0->12) 00002000:00010000:1.0:1790710878.722192:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c51d03fad80 00000100:00100000:1.0:1790710878.722243:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 6 00000100:00100000:1.0:1790710878.722253:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d03fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+11:2358:x1877696158200960:12345-192.168.206.46@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1790710878.723727:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d03fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+13:2358:x1877696158200960:12345-192.168.206.46@tcp:4:lhsmtool_posix.0 Request processed in 1462us (1822us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1790710878.723742:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 6 00002000:00100000:1.0:1790710878.723757:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff9c51d03fad80 x1877696158200960/t4294967320(0) o4->0ec73bd1-726e-4dc0-8edd-807d3f973d65@192.168.206.46@tcp:379/0 lens 504/448 e 0 to 0 dl 1790710889 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790710878.723767:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c51d03fad80 with x1877696158200960 ext(0->12) 00002000:00010000:1.0:1790710878.723773:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c51d03fad80 00000100:00100000:0.0:1790710878.728121:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710878.728266:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158201088 00000100:00100000:3.0:1790710878.728279:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158201088 00000100:00100000:3.0:1790710878.728357:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 226 00000100:00100000:3.0:1790710878.728369:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff045f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+66:11596:x1877696158201088:12345-192.168.206.46@tcp:44:lhsmtool_posix.0 00010000:00010000:2.0:1790710878.729430:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1790710878.775585:0:5867:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967503 is committed 00000020:00080000:0.0:1790710878.775612:0:5867:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c51f01e6d80 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1790710878.775619:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c51ff477400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c51f01e6540 00000020:00080000:0.0:1790710878.775622:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c51ff477b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c51ff866000 00000020:00080000:3.0:1790710878.775647:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000001:00080000:0.0:1790710878.775648:0:5867:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967507 is committed 00000004:00080000:0.0:1790710878.775657:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000004:00080000:0.0:1790710878.775687:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000004:00080000:0.0:1790710878.775743:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:0.0:1790710878.775767:0:5867:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c51f4045f00 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1790710878.775770:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c51c8097f00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c51f4045000 00000020:00080000:0.0:1790710878.775772:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c51c8097b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c51f4063800 00000020:00080000:0.0:1790710878.775801:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000100:00100000:3.0:1790710878.775831:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790710878.775854:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51ff121f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1877696177058560:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1790710878.775943:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1790710878.776034:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1790710878.776043:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790710878.776068:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51ff120700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177058432:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1790710878.776150:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710878.776204:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177058560 00000100:00100000:3.0:1790710878.776220:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177058560 00000100:00100000:1.0:1790710878.776274:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790710878.776283:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177058432 00000100:00100000:3.0:1790710878.776287:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177058432 00000100:00100000:1.0:1790710878.776297:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9765880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1877696177058688:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1790710878.776310:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1790710878.776318:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff120e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3310:x1877696177058560:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1790710878.776328:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1790710878.776349:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790710878.776360:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177058688 00000100:00100000:1.0:1790710878.776364:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177058688 00000100:00100000:1.0:1790710878.776391:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1790710878.776398:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9a50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3311:x1877696177058432:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1790710878.776422:0:6697:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:1.0:1790710878.776448:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e50bad2/0xcbad34b281571c53 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.776474:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000363dfc64/0xcbad34b281571a15 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.46@tcp remote: 0x566877b0570006fc expref: 12 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790710878.776478:0:6698:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1790710878.776482:0:6698:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1790710878 00010000:00010000:1.0:1790710878.776483:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=2s v=(0 0) 00002000:00010000:3.0:1790710878.776485:0:6698:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00010000:00010000:1.0:1790710878.776488:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790710878.776494:0:6697:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e50bad2/0xcbad34b281571c53 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.776525:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000363dfc64/0xcbad34b281571a15 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.46@tcp remote: 0x566877b0570006fc expref: 12 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.776541:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000363dfc64/0xcbad34b281571a15 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.46@tcp remote: 0x566877b0570006fc expref: 12 pid: 6696 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710878.776555:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f498f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1877696177058816:192.168.206.46@tcp:104: 00000100:00100000:1.0:1790710878.776620:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c811ee40 going to sleep for 11 seconds 00002000:00010000:3.0:1790710878.776627:0:6698:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1790710878 -> 1790710878 00002000:00010000:3.0:1790710878.776629:0:6698:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00080000:1.0:1790710878.776630:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790710878.776738:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff120e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3310:x1877696177058560:12345-0@lo:2:osp-syn-1-0.0 Request processed in 419us (795us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1790710878.776746:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1790710878.776767:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1790710878.776774:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f498e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1877696177058688:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1790710878.776787:0:6698:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:3.0:1790710878.776812:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6abc145d, atime: 0x6abc145d, ctime: 0x6abc145d, blocks: 0xb 00010000:00010000:3.0:1790710878.776817:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b271cda/0xcbad34b281571c5a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710878.776826:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=356s v=(0 0) 00010000:00010000:3.0:1790710878.776830:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790710878.776850:0:6698:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b271cda/0xcbad34b281571c5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710878.776866:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b271cda/0xcbad34b281571c5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710878.776889:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b271cda/0xcbad34b281571c5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710878.776898:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b271cda/0xcbad34b281571c5a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710878.776926:0:6698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1790710878.777182:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff045f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+20:11596:x1877696158201088:12345-192.168.206.46@tcp:44:lhsmtool_posix.0 Request processed in 48814us (49072us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710878.777191:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 226 00000100:00100000:3.0:1790710878.777589:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f498e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3309:x1877696177058688:12345-0@lo:6:osp-syn-0-0.0 Request processed in 814us (1256us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1790710878.777596:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1790710878.777606:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:2.0:1790710878.777612:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c51fa2cf800, transno 4294967307 00000004:00080000:2.0:1790710878.777624:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967309 00000100:00100000:2.0:1790710878.777648:0:3309:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9c51f9765880 x1877696177058688/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1790710894 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1790710878.777661:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c51f9765880/2, rc 0, transno 4294967310 00000100:00100000:2.0:1790710878.777666:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9765880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1877696177058688:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1790710878.778176:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790710878.778186:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b271cda/0xcbad34b281571c5a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710878.778199:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c8046800 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:0.0:1790710878.778204:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b271cda/0xcbad34b281571c5a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710878.778217:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b271cda/0xcbad34b281571c5a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790710878.778236:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c51ff121f80/2, rc 0, transno 4294967321 00010000:00010000:0.0:1790710878.778238:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b271cda/0xcbad34b281571c5a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710878.778242:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51ff121f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1877696177058560:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1790710878.778246:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b271cda/0xcbad34b281571c5a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710878.778272:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790710878.778275:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790710878.778840:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790710878.781336:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710878.781470:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f498f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1877696177058816:192.168.206.46@tcp:104: 00010000:00010000:1.0:1790710878.781510:0:6697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009e50bad2/0xcbad34b281571c53 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710878.781672:0:8449:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158201216 00000100:00100000:2.0:1790710878.781682:0:8449:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158201216 00010000:00010000:2.0:1790710878.781730:0:8449:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000363dfc64/0xcbad34b281571a15 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.46@tcp remote: 0x566877b0570006fc expref: 13 pid: 6696 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710878.781775:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 81 00000100:00100000:2.0:1790710878.781785:0:8449:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff045180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+13:2359:x1877696158201216:12345-192.168.206.46@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1790710878.782489:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710878.782576:0:6696:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158201344 00000100:00100000:0.0:1790710878.782583:0:6696:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158201344 00010000:00010000:2.0:1790710878.782615:0:8449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790710878.782625:0:8449:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000363dfc64/0xcbad34b281571a15 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.46@tcp remote: 0x566877b0570006fc expref: 14 pid: 6696 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710878.782626:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 68 00000100:00100000:0.0:1790710878.782634:0:6696:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+14:2359:x1877696158201344:12345-192.168.206.46@tcp:16:lhsmtool_posix.0 00010000:00010000:2.0:1790710878.782641:0:8449:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000363dfc64/0xcbad34b281571a15 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.46@tcp remote: 0x566877b0570006fc expref: 14 pid: 6696 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710878.782867:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000363dfc64/0xcbad34b281571a15 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.46@tcp remote: 0x566877b0570006fc expref: 14 pid: 6696 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710878.782888:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790710878.782892:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790710878.782898:0:8449:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009e50bad2/0xcbad34b281571c53 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710878.782910:0:8449:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e50bad2/0xcbad34b281571c53 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710878.782951:0:8449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790710878.783034:0:8449:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff045180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+13:2359:x1877696158201216:12345-192.168.206.46@tcp:103:ldlm_bl.0 Request processed in 1249us (1711us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710878.783043:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 81 00010000:00010000:2.0:1790710878.783075:0:6697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009e50bad2/0xcbad34b281571c53 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710878.783085:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e50bad2/0xcbad34b281571c53 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710878.783115:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e50bad2/0xcbad34b281571c53 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710878.783125:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009e50bad2/0xcbad34b281571c53 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710878.783164:0:6697:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1790710878.784507:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9a50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3311:x1877696177058432:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8101us (8349us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1790710878.784522:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00010000:2.0:1790710878.784721:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790710878.784730:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009e50bad2/0xcbad34b281571c53 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710878.784742:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c6480400 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:2.0:1790710878.784747:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009e50bad2/0xcbad34b281571c53 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710878.784758:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009e50bad2/0xcbad34b281571c53 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710878.784780:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009e50bad2/0xcbad34b281571c53 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710878.784788:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e50bad2/0xcbad34b281571c53 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710878.784819:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710878.784821:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710878.784823:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1790710878.786404:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c51ff120700/2, rc 0, transno 4294967322 00000100:00100000:1.0:1790710878.786427:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51ff120700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177058432:0@lo:6:osp-syn-1-0.0 00000001:00080000:1.0:1790710878.842978:0:7643:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967317 is committed 00000001:00080000:1.0:1790710878.843212:0:7643:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000001:00080000:1.0:1790710878.843228:0:7643:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000100:00100000:2.0:1790710878.843446:0:6696:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+7:2359:x1877696158201344:12345-192.168.206.46@tcp:16:lhsmtool_posix.0 Request processed in 60803us (60951us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710878.843460:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 68 00000100:00100000:3.0:1790710878.850465:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710878.850590:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158201600 00000100:00100000:1.0:1790710878.850603:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158201600 00000100:00100000:1.0:1790710878.850674:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 227 00000100:00100000:1.0:1790710878.850685:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff121500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+20:11596:x1877696158201600:12345-192.168.206.46@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790710878.850752:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790710878.850786:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b281571c3e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700078f expref: 20 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.850812:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c51cca25200) 00010000:00010000:1.0:1790710878.850818:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790710878.850855:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571c61 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.850872:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571c61 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.850882:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571c61 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790710878.851334:0:5846:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000005c07f7f reply state 000000005cc2a366 transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571c61 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710878.851367:0:5846:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790710878.851498:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff121500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+21:11596:x1877696158201600:12345-192.168.206.46@tcp:36:lhsmtool_posix.0 Request processed in 813us (1046us total) trans 4294967508 rc 0/0 00000100:00100000:1.0:1790710878.851507:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 227 00000100:00100000:0.0:1790710878.853750:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710878.853880:0:12058:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158201728 00000100:00100000:3.0:1790710878.853893:0:12058:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158201728 00000100:00100000:3.0:1790710878.853965:0:12058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 69 00000100:00100000:3.0:1790710878.853976:0:12058:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff045880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+7:2359:x1877696158201728:12345-192.168.206.46@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1790710878.854340:0:12058:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1790710878.854345:0:12058:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1790710878 -> 1790710877 00002000:00010000:3.0:1790710878.854348:0:12058:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1790710877 00002000:00010000:3.0:1790710878.854350:0:12058:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1790710878 -> 1790710877 00002000:00010000:3.0:1790710878.854352:0:12058:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1790710878.854419:0:12058:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff045880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+8:2359:x1877696158201728:12345-192.168.206.46@tcp:2:lhsmtool_posix.0 Request processed in 443us (682us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1790710878.854429:0:12058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 69 00010000:00010000:1.0:1790710878.854807:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571c61 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.854819:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571c61 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.854828:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571c61 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.854836:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c6480c00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1790710878.854841:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571c61 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.854849:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571c61 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.854868:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c51cca25200) 00010000:00010000:1.0:1790710878.854871:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790710878.854877:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571c61 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.854883:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571c61 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710878.857264:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710878.857546:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158201984 00000100:00100000:1.0:1790710878.857559:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158201984 00000100:00100000:1.0:1790710878.857648:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 228 00000100:00100000:1.0:1790710878.857659:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d03f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+20:11596:x1877696158201984:12345-192.168.206.46@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1790710878.857749:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481200/0xcbad34b281571c68 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.857769:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8200/0xcbad34b281571c22 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000781 expref: 20 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.857778:0:5845:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481200/0xcbad34b281571c68 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.857821:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8200/0xcbad34b281571c22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.46@tcp remote: 0x566877b057000781 expref: 20 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.857838:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8200/0xcbad34b281571c22 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000781 expref: 20 pid: 5847 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710878.857856:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f498f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1877696177058944:192.168.206.46@tcp:104: 00000100:00100000:1.0:1790710878.858023:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c78e1840 going to sleep for 11 seconds 00000100:00100000:2.0:1790710878.868573:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710878.868840:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f498f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1877696177058944:192.168.206.46@tcp:104: 00000100:00100000:3.0:1790710878.868869:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158202112 00010000:00010000:1.0:1790710878.868874:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481200/0xcbad34b281571c68 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710878.868880:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158202112 00010000:00010000:3.0:1790710878.868929:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8200/0xcbad34b281571c22 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000781 expref: 21 pid: 5847 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710878.868983:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 82 00000100:00100000:3.0:1790710878.868994:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d03fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+21:2358:x1877696158202112:12345-192.168.206.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790710878.869013:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790710878.869020:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8200/0xcbad34b281571c22 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000781 expref: 21 pid: 5847 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710878.869034:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8200/0xcbad34b281571c22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000781 expref: 21 pid: 5847 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710878.869058:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8200/0xcbad34b281571c22 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000781 expref: 21 pid: 5847 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710878.869077:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c51cca25200) 00010000:00010000:3.0:1790710878.869083:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481200/0xcbad34b281571c68 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710878.869106:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481200/0xcbad34b281571c68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710878.869116:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481200/0xcbad34b281571c68 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710878.869183:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790710878.869195:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481200/0xcbad34b281571c68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.869204:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481200/0xcbad34b281571c68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710878.869252:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d03fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+20:2358:x1877696158202112:12345-192.168.206.46@tcp:103:ldlm_bl.0 Request processed in 258us (694us total) trans 0 rc 0/0 00010000:00010000:1.0:1790710878.869257:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481200/0xcbad34b281571c68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.869274:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481200/0xcbad34b281571c68 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710878.869280:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 82 00010000:00010000:1.0:1790710878.869287:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481200/0xcbad34b281571c68 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.869295:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c6481200 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1790710878.869299:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481200/0xcbad34b281571c68 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.869307:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481200/0xcbad34b281571c68 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.869317:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c51cca25200) 00010000:00010000:1.0:1790710878.869320:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1790710878.869323:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481200/0xcbad34b281571c68 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.869330:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481200/0xcbad34b281571c68 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710878.869371:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d03f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+19:11596:x1877696158201984:12345-192.168.206.46@tcp:55:lhsmtool_posix.0 Request processed in 11715us (12121us total) trans 0 rc -22/-22 00000100:00100000:1.0:1790710878.869379:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 228 00000100:00100000:0.0:1790710878.872010:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710878.872213:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158202240 00000100:00100000:2.0:1790710878.872226:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158202240 00000100:00100000:2.0:1790710878.872300:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 70 00000100:00100000:2.0:1790710878.872312:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff047100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+8:2359:x1877696158202240:12345-192.168.206.46@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1790710878.872609:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c0f8eb9c/0xcbad34b281571c6f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710878.872636:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cc496669/0xcbad34b281571c4c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.46@tcp remote: 0x566877b05700079d expref: 8 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710878.872645:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790710878.872650:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790710878.872655:0:6697:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0f8eb9c/0xcbad34b281571c6f lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710878.872696:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cc496669/0xcbad34b281571c4c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.46@tcp remote: 0x566877b05700079d expref: 8 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710878.872747:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cc496669/0xcbad34b281571c4c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.46@tcp remote: 0x566877b05700079d expref: 8 pid: 6697 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710878.872765:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51d03f9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1877696177059072:192.168.206.46@tcp:104: 00000100:00100000:2.0:1790710878.872870:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f4013cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790710878.882474:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710878.882737:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158202368 00000100:00100000:0.0:1790710878.882747:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158202368 00000100:00100000:1.0:1790710878.882760:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51d03f9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1877696177059072:192.168.206.46@tcp:104: 00010000:00010000:1.0:1790710878.882795:0:6697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c0f8eb9c/0xcbad34b281571c6f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710878.882798:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cc496669/0xcbad34b281571c4c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.46@tcp remote: 0x566877b05700079d expref: 9 pid: 6697 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710878.882871:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 83 00000100:00100000:0.0:1790710878.882882:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d03f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+9:2359:x1877696158202368:12345-192.168.206.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790710878.882902:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790710878.882931:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cc496669/0xcbad34b281571c4c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.46@tcp remote: 0x566877b05700079d expref: 9 pid: 6697 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710878.882955:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cc496669/0xcbad34b281571c4c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.46@tcp remote: 0x566877b05700079d expref: 9 pid: 6697 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710878.882985:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc496669/0xcbad34b281571c4c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.46@tcp remote: 0x566877b05700079d expref: 9 pid: 6697 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710878.883006:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790710878.883011:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790710878.883018:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c0f8eb9c/0xcbad34b281571c6f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710878.883029:0:5831:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0f8eb9c/0xcbad34b281571c6f lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710878.883081:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790710878.883149:0:6697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c0f8eb9c/0xcbad34b281571c6f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.883159:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c0f8eb9c/0xcbad34b281571c6f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.883191:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c0f8eb9c/0xcbad34b281571c6f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.883201:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c0f8eb9c/0xcbad34b281571c6f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.883211:0:6697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c0f8eb9c/0xcbad34b281571c6f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710878.883221:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d03f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+8:2359:x1877696158202368:12345-192.168.206.46@tcp:103:ldlm_bl.0 Request processed in 337us (759us total) trans 0 rc 0/0 00010000:00010000:1.0:1790710878.883222:0:6697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51f43f9800 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:1.0:1790710878.883229:0:6697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0f8eb9c/0xcbad34b281571c6f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710878.883236:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 83 00010000:00010000:1.0:1790710878.883246:0:6697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0f8eb9c/0xcbad34b281571c6f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.883260:0:6697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c0f8eb9c/0xcbad34b281571c6f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.883279:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c0f8eb9c/0xcbad34b281571c6f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710878.883332:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff047100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+7:2359:x1877696158202240:12345-192.168.206.46@tcp:1:lhsmtool_posix.0 Request processed in 11021us (11334us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710878.883341:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 70 00000100:00100000:3.0:1790710878.887206:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710878.887314:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158202624 00000100:00100000:1.0:1790710878.887328:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158202624 00000100:00100000:1.0:1790710878.887401:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 229 00000100:00100000:1.0:1790710878.887412:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff120a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+19:11596:x1877696158202624:12345-192.168.206.46@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1790710878.887530:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481200/0xcbad34b281571c76 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.887551:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481200/0xcbad34b281571c76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.887564:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481200/0xcbad34b281571c76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.887837:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571c7d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.887849:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b281571c30 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000788 expref: 20 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.887859:0:5846:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571c7d lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.887924:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b281571c30 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.46@tcp remote: 0x566877b057000788 expref: 20 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.887942:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b281571c30 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000788 expref: 20 pid: 5845 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710878.887958:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f498f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1877696177059200:192.168.206.46@tcp:104: 00000100:00100000:1.0:1790710878.888052:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c78e1840 going to sleep for 11 seconds 00000100:00100000:1.0:1790710878.891378:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f498f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1877696177059200:192.168.206.46@tcp:104: 00010000:00010000:1.0:1790710878.891416:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571c7d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710878.892624:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710878.893433:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158202752 00000100:00100000:1.0:1790710878.893446:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158202752 00010000:00010000:1.0:1790710878.893573:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b281571c30 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000788 expref: 21 pid: 5845 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710878.893672:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 84 00000100:00100000:1.0:1790710878.893683:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff123100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+21:2358:x1877696158202752:12345-192.168.206.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790710878.893703:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790710878.893711:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b281571c30 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000788 expref: 21 pid: 5845 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.893736:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b281571c30 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000788 expref: 21 pid: 5845 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.893785:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b281571c30 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000788 expref: 21 pid: 5845 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.893804:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c51cca25200) 00010000:00010000:1.0:1790710878.893810:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571c7d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.893821:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571c7d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.893830:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571c7d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.893871:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790710878.893956:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff123100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+20:2358:x1877696158202752:12345-192.168.206.46@tcp:103:ldlm_bl.0 Request processed in 274us (1339us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710878.893965:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 84 00010000:00010000:0.0:1790710878.894049:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571c7d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710878.894058:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571c7d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790710878.894281:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:0.0:1790710878.894444:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:0.0:1790710878.894758:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:0.0:1790710878.894872:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51ff047b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5846:1877696177059328:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1790710878.894965:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710878.895155:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c12ed900 going to sleep for 11 seconds 00000100:00100000:1.0:1790710878.896686:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177059328 00000100:00100000:1.0:1790710878.896702:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177059328 00000100:00100000:1.0:1790710878.896884:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790710878.896896:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff047480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1877696177059328:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1790710878.897075:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff047480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1877696177059328:12345-0@lo:1000:mdt00_001.0 Request processed in 181us (2108us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710878.897083:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790710878.897190:0:5846:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:2.0:1790710878.897198:0:5846:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967322 00000004:00080000:2.0:1790710878.897221:0:5846:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c51ff121f80, transno 4294967321 00000004:00080000:2.0:1790710878.897239:0:5846:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c51ff120700, transno 4294967322 00000100:00100000:2.0:1790710878.897247:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51ff047b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5846:1877696177059328:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1790710878.898047:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:2.0:1790710878.898197:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51d03f9500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5846:1877696177059456:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1790710878.898264:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710878.899456:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f4013240 going to sleep for 11 seconds 00000100:00100000:0.0:1790710878.899572:0:5851:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177059456 00000100:00100000:0.0:1790710878.899582:0:5851:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177059456 00000100:00100000:0.0:1790710878.899639:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790710878.899650:0:5851:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d03f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5846:x1877696177059456:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1790710878.900350:0:5851:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d03f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5846:x1877696177059456:12345-0@lo:1000:mdt00_001.0 Request processed in 697us (2080us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1790710878.900362:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790710878.900629:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51d03f9500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5846:1877696177059456:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1790710878.900682:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571c7d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710878.900695:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571c7d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710878.900704:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571c7d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710878.900788:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c6480c00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1790710878.900811:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571c7d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710878.900822:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571c7d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710878.900841:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c51cca25200) 00010000:00010000:2.0:1790710878.900845:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790710878.900850:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571c7d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710878.900857:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480c00/0xcbad34b281571c7d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710878.900898:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243bc00/0xcbad34b281571bc0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710878.900905:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243bc00/0xcbad34b281571bc0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710878.900912:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243bc00/0xcbad34b281571bc0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710878.900917:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c243bc00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1790710878.900921:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243bc00/0xcbad34b281571bc0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710878.900927:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243bc00/0xcbad34b281571bc0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710878.901075:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c51c2c2e800) 00010000:00010000:2.0:1790710878.901079:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790710878.901105:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b281571bc7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700076c expref: 23 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710878.901119:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b281571bc7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700076c expref: 23 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710878.901379:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b281571bc7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700076c expref: 23 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710878.901427:0:5846:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b281571bc7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700076c expref: 23 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710878.901444:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51d03f9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1877696177059584:192.168.206.46@tcp:105: 00000100:00100000:2.0:1790710878.901555:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f4013240 going to sleep for 11 seconds 00000100:00100000:3.0:1790710878.905936:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710878.906202:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51d03f9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1877696177059584:192.168.206.46@tcp:105: 00010000:00010000:0.0:1790710878.906243:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243bc00/0xcbad34b281571bc0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710878.906280:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243bc00/0xcbad34b281571bc0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710878.906324:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ac00/0xcbad34b281571c84 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710878.906343:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ac00/0xcbad34b281571c84 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710878.906357:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ac00/0xcbad34b281571c84 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710878.906370:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ac00/0xcbad34b281571c84 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710878.906377:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ac00/0xcbad34b281571c84 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710878.906384:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ac00/0xcbad34b281571c84 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710878.906389:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c243ac00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1790710878.906393:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ac00/0xcbad34b281571c84 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710878.906402:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ac00/0xcbad34b281571c84 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710878.906414:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c51c2c2e800) 00010000:00010000:0.0:1790710878.906417:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790710878.906421:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ac00/0xcbad34b281571c84 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710878.906433:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ac00/0xcbad34b281571c84 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710878.906444:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481200/0xcbad34b281571c76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710878.906449:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481200/0xcbad34b281571c76 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710878.906454:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481200/0xcbad34b281571c76 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710878.906459:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c6481200 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1790710878.906462:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481200/0xcbad34b281571c76 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710878.906467:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481200/0xcbad34b281571c76 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710878.906475:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c51c2c2e800) 00010000:00010000:0.0:1790710878.906477:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790710878.906480:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481200/0xcbad34b281571c76 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710878.906484:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481200/0xcbad34b281571c76 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710878.906904:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff120a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+23:11596:x1877696158202624:12345-192.168.206.46@tcp:57:lhsmtool_posix.0 Request processed in 19491us (19708us total) trans 4294967513 rc 0/0 00000100:00100000:0.0:1790710878.906916:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 229 00000020:00080000:0.0:1790710878.906934:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1790710878.907180:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790710878.907186:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790710878.907827:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1790710878.907851:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790710878.908354:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158202880 00000100:00100000:2.0:1790710878.908367:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158202880 00000100:00100000:2.0:1790710878.908437:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 61 00000100:00100000:2.0:1790710878.908447:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff121f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+23:11595:x1877696158202880:12345-192.168.206.46@tcp:49:lfs.0 00000100:00100000:2.0:1790710878.908672:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff121f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+23:11595:x1877696158202880:12345-192.168.206.46@tcp:49:lfs.0 Request processed in 225us (2749us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710878.908680:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 61 00000100:00100000:3.0:1790710878.911917:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710878.912304:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158203136 00000100:00100000:2.0:1790710878.912316:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158203136 00000100:00100000:2.0:1790710878.912526:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 62 00000100:00100000:2.0:1790710878.912538:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d6260c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+23:11596:x1877696158203136:12345-192.168.206.46@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1790710878.913891:0:5848:0:(mdd_object.c:4180:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1790710878.914217:0:5848:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967514 00010000:00010000:2.0:1790710878.914304:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8600/0xcbad34b281571c8b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710878.914385:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8600/0xcbad34b281571c8b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710878.914401:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8600/0xcbad34b281571c8b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710878.914410:0:5848:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8600/0xcbad34b281571c8b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710878.914417:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8600/0xcbad34b281571c8b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710878.914424:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8600/0xcbad34b281571c8b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710878.914445:0:5848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790710878.915166:0:8509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790710878.915178:0:8509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8600/0xcbad34b281571c8b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710878.915186:0:8509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51f43f8600 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:3.0:1790710878.915190:0:8509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8600/0xcbad34b281571c8b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710878.915199:0:8509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8600/0xcbad34b281571c8b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710878.915215:0:8509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c51cca25200) 00010000:00010000:3.0:1790710878.915218:0:8509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1790710878.915223:0:8509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8600/0xcbad34b281571c8b lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710878.915228:0:8509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8600/0xcbad34b281571c8b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710878.915252:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790710878.915254:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790710878.915255:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790710878.917579:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d6260c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+25:11596:x1877696158203136:12345-192.168.206.46@tcp:35:lhsmtool_posix.0 Request processed in 4958us (5592us total) trans 4294967515 rc 0/0 00000100:00100000:2.0:1790710878.917596:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 62 00000020:00080000:2.0:1790710878.917606:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1790710878.917801:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710878.918219:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158203392 00000100:00100000:2.0:1790710878.918230:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158203392 00000100:00100000:2.0:1790710878.918344:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 230 00000100:00100000:2.0:1790710878.918355:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff120700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+25:11595:x1877696158203392:12345-192.168.206.46@tcp:58:lfs.0 00000040:00080000:2.0:1790710878.918677:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1790710878.918787:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff120700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+25:11595:x1877696158203392:12345-192.168.206.46@tcp:58:lfs.0 Request processed in 433us (985us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710878.918795:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 230 00000100:00100000:3.0:1790710878.952487:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710878.952773:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158203520 00000100:00100000:1.0:1790710878.952787:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158203520 00000100:00100000:1.0:1790710878.952860:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 231 00000100:00100000:1.0:1790710878.952872:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff121180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+25:11598:x1877696158203520:12345-192.168.206.46@tcp:101:lfs.0 00010000:00010000:1.0:1790710878.952906:0:8060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790710878.952934:0:8060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b281571c92 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b0570007a4 expref: -99 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.953342:0:8060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480200/0xcbad34b281571c99 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.953362:0:8060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480200/0xcbad34b281571c99 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.953375:0:8060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480200/0xcbad34b281571c99 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.953392:0:8060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571ca0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.953400:0:8060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571ca0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.953407:0:8060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571ca0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.953814:0:8060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481400/0xcbad34b281571ca7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.953829:0:8060:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243a400/0xcbad34b281571bb2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000765 expref: 26 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.953853:0:8060:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481400/0xcbad34b281571ca7 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.953896:0:8060:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243a400/0xcbad34b281571bb2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.46@tcp remote: 0x566877b057000765 expref: 26 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.953914:0:8060:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243a400/0xcbad34b281571bb2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000765 expref: 26 pid: 5846 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710878.953931:0:8060:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f498f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8060:1877696177059712:192.168.206.46@tcp:104: 00000100:00100000:0.0:1790710878.956101:0:8060:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c78e1840 going to sleep for 11 seconds 00000100:00100000:3.0:1790710878.960476:0:8060:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f498f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8060:1877696177059712:192.168.206.46@tcp:104: 00010000:00010000:3.0:1790710878.960599:0:8060:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481400/0xcbad34b281571ca7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710878.961368:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710878.961662:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158203776 00000100:00100000:1.0:1790710878.961674:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158203776 00000100:00100000:1.0:1790710878.961740:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 63 00000100:00100000:1.0:1790710878.961750:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d03fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+27:5594:x1877696158203776:12345-192.168.206.46@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1790710878.962075:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d03fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+28:5594:x1877696158203776:12345-192.168.206.46@tcp:35:ldlm_bl.0 Request processed in 324us (710us total) trans 4294967516 rc 0/0 00000100:00100000:1.0:1790710878.962084:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 63 00000100:00100000:0.0:1790710878.968644:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710878.968769:0:8449:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158203904 00000100:00100000:2.0:1790710878.968783:0:8449:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158203904 00010000:00010000:2.0:1790710878.968835:0:8449:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243a400/0xcbad34b281571bb2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000765 expref: 28 pid: 5846 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710878.968881:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 85 00000100:00100000:2.0:1790710878.968892:0:8449:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff047800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+28:2358:x1877696158203904:12345-192.168.206.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790710878.968910:0:8449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790710878.968917:0:8449:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243a400/0xcbad34b281571bb2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000765 expref: 28 pid: 5846 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710878.968931:0:8449:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243a400/0xcbad34b281571bb2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000765 expref: 28 pid: 5846 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710878.968970:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243a400/0xcbad34b281571bb2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000765 expref: 28 pid: 5846 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710878.968992:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c51c2c2e800) 00010000:00010000:2.0:1790710878.969248:0:8449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481400/0xcbad34b281571ca7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710878.969263:0:8449:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481400/0xcbad34b281571ca7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710878.969275:0:8449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481400/0xcbad34b281571ca7 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710878.969308:0:8449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790710878.969407:0:8449:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff047800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+27:2358:x1877696158203904:12345-192.168.206.46@tcp:103:ldlm_bl.0 Request processed in 516us (777us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710878.969417:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 85 00010000:00010000:1.0:1790710878.970952:0:8060:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481400/0xcbad34b281571ca7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.970969:0:8060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481400/0xcbad34b281571ca7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790710878.971036:0:8060:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1790710878.971041:0:8060:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790710878.971066:0:8060:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481400/0xcbad34b281571ca7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.971114:0:8060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481400/0xcbad34b281571ca7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.971153:0:8060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480200/0xcbad34b281571c99 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.971161:0:8060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480200/0xcbad34b281571c99 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.971169:0:8060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480200/0xcbad34b281571c99 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.971174:0:8060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c6480200 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1790710878.971179:0:8060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480200/0xcbad34b281571c99 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.971187:0:8060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480200/0xcbad34b281571c99 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.971204:0:8060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c51cca25000) 00010000:00010000:1.0:1790710878.971207:0:8060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790710878.971212:0:8060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480200/0xcbad34b281571c99 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.971218:0:8060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6480200/0xcbad34b281571c99 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.971234:0:8060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571ca0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.971239:0:8060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571ca0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.971254:0:8060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571ca0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.971260:0:8060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c6481000 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1790710878.971263:0:8060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571ca0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.971270:0:8060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571ca0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.971278:0:8060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c51d8e33a00) 00010000:00010000:1.0:1790710878.971281:0:8060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790710878.971284:0:8060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571ca0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.971290:0:8060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481000/0xcbad34b281571ca0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.971349:0:8060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481c00/0xcbad34b281571c92 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570007a4 expref: 27 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.971366:0:8060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481400/0xcbad34b281571ca7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570007a4 expref: 26 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710878.971374:0:8060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c51c2c2e800) 00010000:00010000:1.0:1790710878.971377:0:8060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790710878.971380:0:8060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c6481400, rc 0) 00000100:00100000:1.0:1790710878.971461:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff121180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+26:11598:x1877696158203520:12345-192.168.206.46@tcp:101:lfs.0 Request processed in 18590us (18986us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710878.971478:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 231 00010000:00010000:0.0:1790710879.752805:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790710879.827621:0:12607:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790710879.827632:0:12607:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790710879.827682:0:12607:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1790710879.827688:0:12607:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1790710879.945096:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790710879.945107:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790710879.945166:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1790710879.945173:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790710879.945347:0:11676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f498f480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11676:1877696177059840:192.168.206.46@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790710879.945487:0:11676:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c78e1a80 going to sleep for 11 seconds 00000100:00100000:2.0:1790710879.949475:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710879.949646:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158204032 00000100:00100000:3.0:1790710879.949657:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158204032 00000100:00100000:3.0:1790710879.949729:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 232 00000100:00100000:3.0:1790710879.949741:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d03f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+27:11610:x1877696158204032:12345-192.168.206.46@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1790710879.949788:0:5845:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1790710879.949928:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d03f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+27:11610:x1877696158204032:12345-192.168.206.46@tcp:53:lhsmtool_posix.0 Request processed in 189us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710879.949937:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 232 00000100:00100000:0.0:1790710879.950922:0:11676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f498f480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11676:1877696177059840:192.168.206.46@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1790710879.954699:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710879.954792:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158204288 00000100:00100000:2.0:1790710879.954805:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158204288 00000100:00100000:2.0:1790710879.954876:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 233 00000100:00100000:2.0:1790710879.954888:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff046a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+26:11610:x1877696158204288:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790710879.954916:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790710879.954954:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9400/0xcbad34b281571cae lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b0570007ab expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710879.955094:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8000/0xcbad34b281571cb5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710879.955112:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8000/0xcbad34b281571cb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710879.955154:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8000/0xcbad34b281571cb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790710879.955168:0:5846:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1790710879.955318:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9400/0xcbad34b281571cae lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570007ab expref: 29 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710879.955338:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8000/0xcbad34b281571cb5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570007ab expref: 28 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710879.955347:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c51c2c2e800) 00010000:00010000:2.0:1790710879.955368:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790710879.955373:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51f43f8000, rc 0) 00000100:00100000:2.0:1790710879.955446:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff046a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+28:11610:x1877696158204288:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 Request processed in 560us (760us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1790710879.955454:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 233 00000100:00100000:3.0:1790710879.959350:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710879.959450:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158204416 00000100:00100000:2.0:1790710879.959462:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158204416 00000100:00100000:2.0:1790710879.959555:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 17 00000100:00100000:2.0:1790710879.959567:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff121880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+28:2359:x1877696158204416:12345-192.168.206.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790710879.959587:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790710879.959617:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8000/0xcbad34b281571cb5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570007ab expref: 28 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710879.959639:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c51c2c2e800) 00010000:00010000:2.0:1790710879.959645:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790710879.959725:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff121880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+27:2359:x1877696158204416:12345-192.168.206.46@tcp:103:ldlm_bl.0 Request processed in 160us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710879.959732:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 17 00000100:00100000:0.0:1790710879.964424:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710879.968392:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158204672 00000100:00100000:3.0:1790710879.968411:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158204672 00000100:00100000:3.0:1790710879.971013:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 234 00000100:00100000:3.0:1790710879.971041:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff047b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+27:11610:x1877696158204672:12345-192.168.206.46@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1790710879.971173:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046200/0xcbad34b281571cc3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710879.971195:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046200/0xcbad34b281571cc3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710879.971209:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046200/0xcbad34b281571cc3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710879.971447:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046200/0xcbad34b281571cc3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710879.971456:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046200/0xcbad34b281571cc3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710879.971471:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046200/0xcbad34b281571cc3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710879.971477:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c8046200 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1790710879.971482:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046200/0xcbad34b281571cc3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710879.971590:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046200/0xcbad34b281571cc3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710879.971605:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c51c2c2e800) 00010000:00010000:3.0:1790710879.971609:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790710879.971616:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046200/0xcbad34b281571cc3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710879.971623:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046200/0xcbad34b281571cc3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710879.971803:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff047b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+28:11610:x1877696158204672:12345-192.168.206.46@tcp:57:lhsmtool_posix.0 Request processed in 773us (7494us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1790710879.971811:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 234 00000040:00080000:0.0:1790710879.972293:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790710879.972299:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790710879.972838:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1790710879.972847:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790710879.979043:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710879.979175:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158204928 00000100:00100000:1.0:1790710879.979188:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158204928 00000100:00100000:1.0:1790710879.979245:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 64 00000100:00100000:1.0:1790710879.979256:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d03f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+28:11610:x1877696158204928:12345-192.168.206.46@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1790710879.979763:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d03f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+29:11610:x1877696158204928:12345-192.168.206.46@tcp:35:lhsmtool_posix.0 Request processed in 506us (730us total) trans 4294967519 rc 0/0 00000100:00100000:1.0:1790710879.979774:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 64 00010000:00010000:2.0:1790710880.775637:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790710881.031454:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c50c35b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1877696177060096:0@lo:400:kworker.0 00000100:00100000:0.0:1790710881.031454:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c50c35b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1877696177060352:0@lo:400:kworker.0 00000100:00100000:2.0:1790710881.031568:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c50c35b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d27fc27-b651-404a-bd8c-b798806fb18a:3311:1877696177059968:0@lo:400:kworker.0 00000100:00100000:3.0:1790710881.034901:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710881.034981:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c50c35b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1877696177060608:0@lo:400:kworker.0 00000100:00100000:3.0:1790710881.035016:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710881.035044:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710881.035068:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790710881.035071:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177060096 00000100:00100000:3.0:1790710881.035089:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177060096 00000100:00100000:0.0:1790710881.035091:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c50c35b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1877696177060224:0@lo:400:kworker.0 00000100:00100000:3.0:1790710881.035162:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1790710881.035195:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff120380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1877696177060096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790710881.035204:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710881.035246:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177060608 00000100:00100000:3.0:1790710881.035250:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff120380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1877696177060096:12345-0@lo:400:kworker.0 Request processed in 66us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710881.035250:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177060608 00000100:00100000:3.0:1790710881.035257:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1790710881.035272:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177060224 00000100:00100000:3.0:1790710881.035275:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177060224 00000100:00100000:0.0:1790710881.035284:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177060352 00000100:00100000:0.0:1790710881.035286:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177060352 00000100:00100000:3.0:1790710881.035292:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1790710881.035297:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c50c35b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1877696177060224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790710881.035304:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1790710881.035309:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3312:x1877696177060608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790710881.035329:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c50c35b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1877696177060224:12345-0@lo:400:kworker.0 Request processed in 32us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710881.035336:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1790710881.035336:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3312:x1877696177060608:12345-0@lo:400:kworker.0 Request processed in 27us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710881.035342:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1790710881.035353:0:12058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00080000:0.0:1790710881.035361:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790710881.035365:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790710881.035367:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790710881.035372:0:12058:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c50c35b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3310:x1877696177060352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790710881.035402:0:12058:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c50c35b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3310:x1877696177060352:12345-0@lo:400:kworker.0 Request processed in 44us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710881.035408:0:12058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1790710881.035442:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c50c35b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1877696177060096:0@lo:400:kworker.0 00000100:00100000:3.0:1790710881.035454:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c50c35b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1877696177060608:0@lo:400:kworker.0 00000100:00100000:3.0:1790710881.035496:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c50c35b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1877696177060224:0@lo:400:kworker.0 00000100:00100000:3.0:1790710881.035507:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c50c35b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1877696177060352:0@lo:400:kworker.0 00000100:00100000:2.0:1790710881.041276:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710881.041332:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c50c35b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1877696177060480:0@lo:400:kworker.0 00000100:00100000:2.0:1790710881.041370:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710881.041429:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177059968 00000100:00100000:1.0:1790710881.041447:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177059968 00000100:00100000:1.0:1790710881.041520:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1790710881.041544:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8ff9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+19:3311:x1877696177059968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790710881.041648:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8ff9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+19:3311:x1877696177059968:12345-0@lo:400:kworker.0 Request processed in 104us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710881.041659:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1790710881.043221:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177060480 00000100:00100000:3.0:1790710881.043233:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177060480 00000100:00100000:3.0:1790710881.043315:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1790710881.043325:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d032c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1877696177060480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790710881.043811:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c50c35b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d27fc27-b651-404a-bd8c-b798806fb18a:3311:1877696177059968:0@lo:400:kworker.0 00000100:00100000:2.0:1790710881.043827:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c50c35b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1877696177060480:0@lo:400:kworker.0 00000100:00080000:1.0:1790710881.043915:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790710881.044654:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d032c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1877696177060480:12345-0@lo:400:kworker.0 Request processed in 91us (2043us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710881.044665:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1790710881.544229:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790710881.544254:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4e6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1877696177060736:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790710881.544334:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710881.544400:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177060736 00000100:00100000:2.0:1790710881.544408:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177060736 00000100:00100000:2.0:1790710881.544454:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1790710881.544464:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f98b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1877696177060736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790710881.544505:0:6699:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790710881.544550:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f98b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1877696177060736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710881.544557:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1790710881.544771:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4e6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1877696177060736:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1790710881.561809:0:12659:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790710881.561819:0:12659:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790710881.561864:0:12659:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1790710881.561869:0:12659:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790710881.735576:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710881.735820:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158205184 00000100:00100000:0.0:1790710881.735830:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158205184 00000100:00100000:0.0:1790710881.735906:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 235 00000100:00100000:0.0:1790710881.735915:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4e6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+29:11632:x1877696158205184:12345-192.168.206.46@tcp:101:lfs.0 00010000:00010000:0.0:1790710881.735938:0:8060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790710881.735958:0:8060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b281571cca lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b0570007b2 expref: -99 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710881.736049:0:8060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ba00/0xcbad34b281571cd1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710881.736064:0:8060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ba00/0xcbad34b281571cd1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710881.736087:0:8060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ba00/0xcbad34b281571cd1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790710881.736099:0:8060:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1790710881.736706:0:8060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b800/0xcbad34b281571cca lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570007b2 expref: 32 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710881.736726:0:8060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ba00/0xcbad34b281571cd1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570007b2 expref: 31 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710881.736736:0:8060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c51c2c2e800) 00010000:00010000:0.0:1790710881.736739:0:8060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1790710881.736752:0:8060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c243ba00, rc 0) 00000100:00100000:0.0:1790710881.736844:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4e6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+31:11632:x1877696158205184:12345-192.168.206.46@tcp:101:lfs.0 Request processed in 929us (1275us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1790710881.736852:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 235 00000100:00080000:1.0:1790710881.736966:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790710881.743033:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710881.743373:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158205312 00000100:00100000:0.0:1790710881.743384:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158205312 00000100:00100000:0.0:1790710881.743548:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 236 00000100:00100000:0.0:1790710881.743560:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4e6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+31:11632:x1877696158205312:12345-192.168.206.46@tcp:54:lfs.0 00010000:00010000:0.0:1790710881.743631:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243be00/0xcbad34b281571cdf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710881.743650:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243be00/0xcbad34b281571cdf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710881.743661:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243be00/0xcbad34b281571cdf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710881.743690:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243be00/0xcbad34b281571cdf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710881.743712:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243be00/0xcbad34b281571cdf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710881.743719:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243be00/0xcbad34b281571cdf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710881.743726:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c243be00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1790710881.743731:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243be00/0xcbad34b281571cdf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710881.743738:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243be00/0xcbad34b281571cdf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710881.743765:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c51c2c2e800) 00010000:00010000:0.0:1790710881.743768:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790710881.743773:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243be00/0xcbad34b281571cdf lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710881.743780:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243be00/0xcbad34b281571cdf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710881.743873:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4e6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+31:11632:x1877696158205312:12345-192.168.206.46@tcp:54:lfs.0 Request processed in 315us (848us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710881.743881:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 236 00010000:00010000:3.0:1790710881.799323:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790710881.811241:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710881.811494:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158205440 00000100:00100000:0.0:1790710881.811504:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158205440 00000100:00100000:0.0:1790710881.811630:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 71 00000100:00100000:0.0:1790710881.811639:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4e6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+7:2356:x1877696158205440:12345-192.168.206.46@tcp:101:cat.0 00010000:00010000:0.0:1790710881.811657:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790710881.811675:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a55bddc4/0xcbad34b281571ce6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b0570007b9 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790710881.811698:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6abc145d, atime: 0x6abc145d, ctime: 0x6abc145d, blocks: 0xb 00010000:00010000:0.0:1790710881.811717:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=359s v=(0 0) 00010000:00010000:0.0:1790710881.811721:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790710881.811731:0:6698:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a55bddc4/0xcbad34b281571ce6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570007b9 expref: 8 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710881.811747:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a55bddc4/0xcbad34b281571ce6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570007b9 expref: 8 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710881.811778:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c243be00, rc 0) 00000100:00100000:0.0:1790710881.811849:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4e6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+8:2356:x1877696158205440:12345-192.168.206.46@tcp:101:cat.0 Request processed in 211us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710881.811857:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 71 00000100:00080000:1.0:1790710881.814869:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790710881.815764:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710881.815882:0:6703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158205568 00000100:00100000:1.0:1790710881.815892:0:6703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158205568 00002000:00100000:1.0:1790710881.815942:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9c51f4e6fb80 x1877696158205568/t0(0) o3->0ec73bd1-726e-4dc0-8edd-807d3f973d65@192.168.206.46@tcp:382/0 lens 488/0 e 0 to 0 dl 1790710892 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790710881.815953:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c51f4e6fb80 with x1877696158205568 ext(0->4095) 00002000:00010000:1.0:1790710881.815958:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c51f4e6fb80 00000100:00100000:1.0:1790710881.816038:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 7 00000100:00100000:1.0:1790710881.816048:0:6703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4e6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+8:2357:x1877696158205568:12345-192.168.206.46@tcp:3:cat.0 00000100:00100000:1.0:1790710881.816284:0:6703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4e6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+8:2357:x1877696158205568:12345-192.168.206.46@tcp:3:cat.0 Request processed in 236us (526us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1790710881.816292:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 7 00002000:00100000:1.0:1790710881.816299:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9c51f4e6fb80 x1877696158205568/t0(0) o3->0ec73bd1-726e-4dc0-8edd-807d3f973d65@192.168.206.46@tcp:382/0 lens 488/4536 e 0 to 0 dl 1790710892 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790710881.816307:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c51f4e6fb80 with x1877696158205568 ext(0->4095) 00002000:00010000:1.0:1790710881.816310:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c51f4e6fb80 00000100:00100000:1.0:1790710882.055434:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790710882.059830:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1877696177060864:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790710882.059908:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710882.063811:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177060864 00000100:00100000:2.0:1790710882.063827:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177060864 00000100:00100000:2.0:1790710882.063902:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1790710882.063912:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f498ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1877696177060864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790710882.064443:0:6699:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790710882.064584:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f498ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1877696177060864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 673us (4675us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710882.064593:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1790710882.069275:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1877696177060864:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790710882.270401:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710882.270454:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710882.270580:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158205696 00000100:00100000:1.0:1790710882.270592:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158205696 00000100:00100000:1.0:1790710882.270655:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 299 00000100:00100000:1.0:1790710882.270664:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8ff9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b75d7a5-152f-4db9-bf19-5fe279a322e3+13:2356:x1877696158205696:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:1.0:1790710882.270758:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8ff9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b75d7a5-152f-4db9-bf19-5fe279a322e3+13:2356:x1877696158205696:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 95us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710882.270767:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 299 00000100:00100000:2.0:1790710882.271011:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710882.271209:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158205824 00000100:00100000:1.0:1790710882.271214:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158205824 00000100:00100000:1.0:1790710882.271264:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 89 00000100:00100000:1.0:1790710882.271272:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+5:2356:x1877696158205824:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:1.0:1790710882.271308:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+5:2356:x1877696158205824:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 37us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710882.271315:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 89 00000100:00080000:2.0:1790710882.271827:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790710882.272120:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158205952 00000100:00100000:0.0:1790710882.272140:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158205952 00000100:00100000:0.0:1790710882.272197:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 159 00000100:00100000:0.0:1790710882.272206:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1b59f23d-9a5c-439d-bd4a-453bf2315b97+5:2356:x1877696158205952:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:0.0:1790710882.272258:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1b59f23d-9a5c-439d-bd4a-453bf2315b97+5:2356:x1877696158205952:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 53us (1803us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710882.272265:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 159 00000100:00080000:2.0:1790710882.272336:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1790710882.823532:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1790710883.149605:0:6720:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00010000:00010000:2.0:1790710883.847743:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1790710884.158432:0:7643:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:0.0:1790710884.158445:0:7643:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:3.0:1790710884.172908:0:5867:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:3.0:1790710884.172929:0:5867:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:3.0:1790710884.172968:0:5867:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c51f4013cc0 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1790710884.172973:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c51c8097500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c51f40136c0 00000020:00080000:3.0:1790710884.172977:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c51c8097000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c51ff08c800 00000020:00080000:1.0:1790710884.173026:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:1.0:1790710884.173303:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:3.0:1790710884.871793:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790710885.753436:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710885.753530:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158206080 00000100:00100000:3.0:1790710885.753549:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158206080 00000100:00080000:2.0:1790710885.753636:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790710885.753662:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 237 00000100:00100000:3.0:1790710885.753687:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f8ce4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+18:11276:x1877696158206080:12345-192.168.206.46@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1790710885.753839:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f8ce4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+18:11276:x1877696158206080:12345-192.168.206.46@tcp:60:lhsmtool_posix.0 Request processed in 167us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710885.753846:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 237 00000100:00100000:2.0:1790710885.759432:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710885.759545:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158206336 00000100:00100000:1.0:1790710885.759555:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158206336 00000100:00100000:1.0:1790710885.759623:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 65 00000100:00100000:1.0:1790710885.759633:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f8ce4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+18:11276:x1877696158206336:12345-192.168.206.46@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1790710885.759974:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f8ce4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+19:11276:x1877696158206336:12345-192.168.206.46@tcp:35:lhsmtool_posix.0 Request processed in 341us (550us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1790710885.759982:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 65 00010000:00010000:0.0:1790710885.896493:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790710886.151403:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f498c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1877696177061248:0@lo:400:kworker.0 00000100:00100000:0.0:1790710886.151474:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710886.151569:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f498f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1877696177061120:0@lo:400:kworker.0 00000100:00100000:3.0:1790710886.151598:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710886.151623:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790710886.151628:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f498d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d27fc27-b651-404a-bd8c-b798806fb18a:3312:1877696177060992:0@lo:400:kworker.0 00000100:00100000:3.0:1790710886.151653:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710886.151684:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177061248 00000100:00100000:3.0:1790710886.151690:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177061248 00000100:00100000:3.0:1790710886.151734:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177061120 00000100:00100000:3.0:1790710886.151738:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177061120 00000100:00100000:3.0:1790710886.151773:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1790710886.151782:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c50c35b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877696177061248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790710886.153196:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177060992 00000100:00100000:2.0:1790710886.153205:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177060992 00000100:00100000:2.0:1790710886.153250:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1790710886.153258:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8ffb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+19:3312:x1877696177060992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790710886.153323:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8ffb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d27fc27-b651-404a-bd8c-b798806fb18a+19:3312:x1877696177060992:12345-0@lo:400:kworker.0 Request processed in 65us (1668us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710886.153330:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00080000:2.0:1790710886.153364:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790710886.153391:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f498d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d27fc27-b651-404a-bd8c-b798806fb18a:3312:1877696177060992:0@lo:400:kworker.0 00000100:00100000:2.0:1790710886.153430:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1790710886.153438:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff120000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1877696177061120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790710886.153473:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff120000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1877696177061120:12345-0@lo:400:kworker.0 Request processed in 36us (1874us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710886.153479:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1790710886.153505:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f498f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1877696177061120:0@lo:400:kworker.0 00000100:00100000:2.0:1790710886.153559:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f498f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1877696177061376:0@lo:400:kworker.0 00000100:00100000:2.0:1790710886.153590:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710886.153623:0:6696:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177061376 00000100:00100000:2.0:1790710886.153627:0:6696:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177061376 00000100:00100000:2.0:1790710886.153671:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1790710886.153677:0:6696:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f8ce5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1877696177061376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790710886.153715:0:6696:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f8ce5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1877696177061376:12345-0@lo:400:kworker.0 Request processed in 38us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710886.153721:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:2.0:1790710886.153735:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790710886.153750:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1790710886.153756:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c51f9765880, transno 4294967310 00000100:00100000:2.0:1790710886.153767:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f498f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1877696177061376:0@lo:400:kworker.0 00000100:00100000:3.0:1790710886.154751:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c50c35b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877696177061248:12345-0@lo:400:kworker.0 Request processed in 2965us (3272us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710886.154761:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1790710886.160786:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f498f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1877696177061504:0@lo:400:kworker.0 00000100:00100000:2.0:1790710886.160874:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710886.160940:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790710886.160958:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f498f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177061632:0@lo:400:kworker.0 00000100:00100000:2.0:1790710886.160988:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710886.161109:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f498c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1877696177061248:0@lo:400:kworker.0 00000100:00100000:3.0:1790710886.161363:0:12058:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177061632 00000100:00100000:3.0:1790710886.161370:0:12058:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177061632 00000100:00100000:3.0:1790710886.161443:0:12058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1790710886.161454:0:12058:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51fef70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1877696177061632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790710886.161514:0:12058:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51fef70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1877696177061632:12345-0@lo:400:kworker.0 Request processed in 63us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710886.161521:0:12058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1790710886.161556:0:3311:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:3.0:1790710886.161562:0:3311:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:3.0:1790710886.161577:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f498f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177061632:0@lo:400:kworker.0 00000100:00080000:2.0:1790710886.161650:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790710886.163258:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177061504 00000100:00100000:1.0:1790710886.163270:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177061504 00000100:00100000:1.0:1790710886.163348:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1790710886.163357:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51fef73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1877696177061504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790710886.163446:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51fef73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1877696177061504:12345-0@lo:400:kworker.0 Request processed in 89us (2571us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710886.163467:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00080000:2.0:1790710886.163550:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790710886.164261:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f498f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1877696177061504:0@lo:400:kworker.0 00000100:00100000:1.0:1790710886.663802:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51fef70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1877696177061760:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790710886.663865:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710886.664015:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177061760 00000100:00100000:3.0:1790710886.664023:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177061760 00000100:00100000:3.0:1790710886.664093:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1790710886.664102:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f498d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877696177061760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790710886.664154:0:6700:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790710886.674237:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f498d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877696177061760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 10127us (10362us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710886.674252:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1790710886.677908:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51fef70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1877696177061760:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1790710886.919300:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790710887.175518:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790710887.175526:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790710887.175855:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:0.0:1790710887.175863:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790710887.180192:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790710887.180216:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51fef70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1877696177061888:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790710887.180283:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710887.181884:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177061888 00000100:00100000:2.0:1790710887.181893:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177061888 00000100:00100000:2.0:1790710887.181944:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1790710887.181952:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f498f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877696177061888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790710887.181986:0:6699:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790710887.182056:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f498f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877696177061888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (1762us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710887.182063:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1790710887.182683:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51fef70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1877696177061888:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790710887.389063:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710887.389366:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158206464 00000100:00100000:0.0:1790710887.389378:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158206464 00000100:00100000:0.0:1790710887.389440:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 301 00000100:00100000:0.0:1790710887.389450:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8ff9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b75d7a5-152f-4db9-bf19-5fe279a322e3+13:2358:x1877696158206464:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:0.0:1790710887.389521:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8ff9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b75d7a5-152f-4db9-bf19-5fe279a322e3+13:2358:x1877696158206464:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 73us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710887.389528:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 301 00000100:00100000:3.0:1790710887.389837:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710887.389868:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710887.389890:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710887.389912:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710887.389936:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158206976 00000100:00100000:3.0:1790710887.389940:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158206976 00000100:00100000:3.0:1790710887.389980:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158206592 00000100:00100000:3.0:1790710887.389983:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158206592 00000100:00100000:3.0:1790710887.390003:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 163 00000100:00100000:3.0:1790710887.390011:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff121c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1b59f23d-9a5c-439d-bd4a-453bf2315b97+5:2358:x1877696158206976:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:3.0:1790710887.390061:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff121c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1b59f23d-9a5c-439d-bd4a-453bf2315b97+5:2358:x1877696158206976:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 51us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710887.390068:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 163 00000100:00100000:3.0:1790710887.390082:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 164 00000100:00100000:3.0:1790710887.390089:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff120e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+19:2358:x1877696158206592:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:3.0:1790710887.390117:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff120e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+19:2358:x1877696158206592:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 29us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710887.390123:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 164 00000100:00100000:3.0:1790710887.390158:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158206720 00000100:00100000:3.0:1790710887.390162:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158206720 00000100:00100000:3.0:1790710887.390186:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158206848 00000100:00100000:3.0:1790710887.390189:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158206848 00000100:00100000:3.0:1790710887.390209:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 92 00000100:00100000:3.0:1790710887.390217:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff121f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+5:2358:x1877696158206720:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:3.0:1790710887.390244:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff121f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+5:2358:x1877696158206720:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 28us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710887.390261:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 92 00000100:00100000:3.0:1790710887.390273:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 93 00000100:00100000:3.0:1790710887.390280:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d03f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+7:2358:x1877696158206848:12345-192.168.206.46@tcp:400:kworker.0 00000100:00080000:0.0:1790710887.390627:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790710887.390631:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790710887.390634:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790710887.390731:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d03f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+7:2358:x1877696158206848:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 450us (816us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710887.390739:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 93 00000001:02000400:2.0:1790710887.506886:0:12861:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 15:41:25 (1790710885) 00010000:00010000:2.0:1790710887.943356:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790710888.968761:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1790710889.283530:0:5867:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:3.0:1790710889.283542:0:5867:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:1.0:1790710889.284179:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1790710889.284189:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:0.0:1790710889.812404:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710889.812487:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158207104 00000100:00100000:3.0:1790710889.812498:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158207104 00000100:00100000:3.0:1790710889.812575:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 238 00000100:00100000:3.0:1790710889.812585:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c50c35b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1b59f23d-9a5c-439d-bd4a-453bf2315b97+5:12296:x1877696158207104:12345-192.168.206.46@tcp:101:lsof.0 00010000:00010000:3.0:1790710889.812605:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790710889.812623:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b281571ced lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b0570007c0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710889.812683:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b281571cf4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710889.812698:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b281571cf4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710889.812711:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b281571cf4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790710889.812745:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790710889.812748:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790710889.812803:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b281571cf4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710889.812827:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046e00/0xcbad34b281571ced lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570007c0 expref: 7 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710889.812847:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b281571cf4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570007c0 expref: 6 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710889.812856:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c51c2c2ec00) 00010000:00010000:3.0:1790710889.812860:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790710889.812863:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c8047800, rc 0) 00000100:00100000:3.0:1790710889.812940:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c50c35b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1b59f23d-9a5c-439d-bd4a-453bf2315b97+6:12296:x1877696158207104:12345-192.168.206.46@tcp:101:lsof.0 Request processed in 356us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710889.812948:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 238 00000100:00080000:0.0:1790710889.813082:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1790710889.991682:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710891.018180:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790710891.271483:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c50c35b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d27fc27-b651-404a-bd8c-b798806fb18a:3311:1877696177062016:0@lo:400:kworker.0 00000100:00100000:3.0:1790710891.271570:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710891.271679:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177062016 00000100:00100000:2.0:1790710891.271688:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177062016 00000100:00100000:2.0:1790710891.271735:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1790710891.271745:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8ff8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+19:3311:x1877696177062016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790710891.271815:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c50c35b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1877696177062144:0@lo:400:kworker.0 00000100:00100000:1.0:1790710891.271849:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710891.275281:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177062144 00000100:00100000:1.0:1790710891.275295:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177062144 00000100:00100000:1.0:1790710891.275356:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1790710891.275365:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f498f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1877696177062144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790710891.275464:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f498f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1877696177062144:12345-0@lo:400:kworker.0 Request processed in 100us (3613us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710891.275471:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1790710891.275514:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c50c35b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1877696177062144:0@lo:400:kworker.0 00000100:00100000:2.0:1790710891.276532:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8ff8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d27fc27-b651-404a-bd8c-b798806fb18a+19:3311:x1877696177062016:12345-0@lo:400:kworker.0 Request processed in 4783us (4956us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710891.276543:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1790710891.276773:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c50c35b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d27fc27-b651-404a-bd8c-b798806fb18a:3311:1877696177062016:0@lo:400:kworker.0 00000100:00100000:2.0:1790710891.279371:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c50c35b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1877696177062272:0@lo:400:kworker.0 00000100:00100000:2.0:1790710891.279442:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710891.279527:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177062272 00000100:00100000:3.0:1790710891.279535:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177062272 00000100:00100000:3.0:1790710891.279596:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1790710891.279605:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51fef70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877696177062272:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1790710891.280537:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790710891.280563:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c50c35b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1877696177062400:0@lo:400:kworker.0 00000100:00100000:1.0:1790710891.280606:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710891.280655:0:6696:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177062400 00000100:00100000:1.0:1790710891.280671:0:6696:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177062400 00000100:00100000:1.0:1790710891.280713:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1790710891.280721:0:6696:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f498c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1877696177062400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790710891.280762:0:6696:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f498c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1877696177062400:12345-0@lo:400:kworker.0 Request processed in 42us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710891.280769:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:1.0:1790710891.280786:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790710891.280810:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c50c35b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1877696177062400:0@lo:400:kworker.0 00000100:00100000:3.0:1790710891.282787:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51fef70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877696177062272:12345-0@lo:400:kworker.0 Request processed in 3176us (3336us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710891.282800:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1790710891.286064:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c50c35b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1877696177062272:0@lo:400:kworker.0 00000100:00100000:3.0:1790710891.286508:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c50c35b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1877696177062528:0@lo:400:kworker.0 00000100:00100000:3.0:1790710891.286585:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710891.286666:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177062528 00000100:00100000:1.0:1790710891.286674:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177062528 00000100:00100000:1.0:1790710891.286743:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1790710891.286752:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f457e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1877696177062528:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1790710891.286868:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790710891.286904:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c50c35b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1877696177062656:0@lo:400:kworker.0 00000100:00100000:2.0:1790710891.286936:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710891.286974:0:12058:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177062656 00000100:00100000:2.0:1790710891.286979:0:12058:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177062656 00000100:00100000:2.0:1790710891.287037:0:12058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1790710891.287046:0:12058:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8e8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1877696177062656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790710891.287082:0:12058:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8e8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1877696177062656:12345-0@lo:400:kworker.0 Request processed in 38us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710891.287088:0:12058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:2.0:1790710891.287113:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790710891.287151:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c50c35b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1877696177062656:0@lo:400:kworker.0 00000100:00100000:1.0:1790710891.287706:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f457e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1877696177062528:12345-0@lo:400:kworker.0 Request processed in 953us (1118us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710891.287714:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1790710891.287866:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c50c35b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1877696177062528:0@lo:400:kworker.0 00000100:00100000:0.0:1790710891.785076:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790710891.785099:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c8e8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1877696177062784:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790710891.785200:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710891.785782:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177062784 00000100:00100000:2.0:1790710891.785792:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177062784 00000100:00100000:2.0:1790710891.785847:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1790710891.785857:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c50c35b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877696177062784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790710891.785918:0:6699:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790710891.785978:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c50c35b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877696177062784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710891.785985:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1790710891.786047:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c8e8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1877696177062784:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790710891.983234:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710891.983334:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158207360 00000100:00100000:3.0:1790710891.983344:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158207360 00000100:00100000:3.0:1790710891.983415:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 66 00000100:00100000:3.0:1790710891.983425:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c50c35b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+18:12297:x1877696158207360:12345-192.168.206.46@tcp:35:umount.0 00000100:00100000:3.0:1790710891.983949:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c50c35b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+19:12297:x1877696158207360:12345-192.168.206.46@tcp:35:umount.0 Request processed in 524us (722us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1790710891.983957:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 66 00000100:00080000:2.0:1790710891.984401:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790710891.989191:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710891.989458:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158207616 00000100:00100000:2.0:1790710891.989468:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158207616 00000100:00100000:2.0:1790710891.989525:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 67 00000100:00100000:2.0:1790710891.989536:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff87d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+19:12297:x1877696158207616:12345-192.168.206.46@tcp:35:umount.0 00000100:00100000:2.0:1790710891.989889:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff87d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+20:12297:x1877696158207616:12345-192.168.206.46@tcp:35:umount.0 Request processed in 344us (695us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1790710891.989898:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 67 00000100:00100000:0.0:1790710891.993430:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710891.993588:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158207872 00000100:00100000:2.0:1790710891.993597:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158207872 00000100:00100000:2.0:1790710891.993705:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 68 00000100:00100000:2.0:1790710891.993717:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d6261450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+20:12297:x1877696158207872:12345-192.168.206.46@tcp:35:umount.0 00000100:00100000:2.0:1790710891.993953:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d6261450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+21:12297:x1877696158207872:12345-192.168.206.46@tcp:35:umount.0 Request processed in 237us (530us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1790710891.993961:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 68 00000100:00100000:0.0:1790710892.001232:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710892.001745:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158208128 00000100:00100000:3.0:1790710892.001756:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158208128 00000100:00100000:3.0:1790710892.001814:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 69 00000100:00100000:3.0:1790710892.001824:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c50c35b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+21:12297:x1877696158208128:12345-192.168.206.46@tcp:35:umount.0 00000100:00100000:3.0:1790710892.002247:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c50c35b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec73bd1-726e-4dc0-8edd-807d3f973d65+22:12297:x1877696158208128:12345-192.168.206.46@tcp:35:umount.0 Request processed in 422us (1022us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1790710892.002255:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 69 00000100:00100000:2.0:1790710892.007010:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710892.007177:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710892.007210:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158208768 00000100:00100000:1.0:1790710892.007221:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158208768 00000100:00100000:1.0:1790710892.007299:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 18 00000100:00100000:1.0:1790710892.007309:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8e5d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b75d7a5-152f-4db9-bf19-5fe279a322e3+13:2358:x1877696158208768:12345-192.168.206.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790710892.007323:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790710892.007342:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c51c6480000/0xcbad34b281570ce0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700031a expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710892.007357:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790710892.007404:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8e5d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b75d7a5-152f-4db9-bf19-5fe279a322e3+12:2358:x1877696158208768:12345-192.168.206.46@tcp:103:ldlm_bl.0 Request processed in 96us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710892.007426:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 18 00000100:00100000:0.0:1790710892.008737:0:6696:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158208512 00000100:00100000:0.0:1790710892.008746:0:6696:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158208512 00000100:00080000:3.0:1790710892.008986:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790710892.009070:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 72 00000100:00100000:0.0:1790710892.009081:0:6696:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8e8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+7:2355:x1877696158208512:12345-192.168.206.46@tcp:9:umount.0 00000020:00000080:0.0:1790710892.009106:0:6696:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcbad34b2815712ba 00000020:00010000:0.0:1790710892.009113:0:6696:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9c51c71c8800: total 0 00000100:00080000:0.0:1790710892.009117:0:6696:0:(import.c:65:import_set_state_nolock()) ffff9c51c71c8000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790710892.009192:0:6696:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000020:00010000:2.0:1790710892.009371:0:5833:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9c51c71c8800: total 0 00010000:00010000:2.0:1790710892.009417:0:5833:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c51c71c8800, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1790710892.009466:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a55bddc4/0xcbad34b281571ce6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570007b9 expref: 5 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710892.009469:0:6696:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8e8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ec73bd1-726e-4dc0-8edd-807d3f973d65+5:2355:x1877696158208512:12345-192.168.206.46@tcp:9:umount.0 Request processed in 391us (2468us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710892.009489:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 72 00010000:00010000:2.0:1790710892.009525:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e092b749/0xcbad34b281571656 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570005f2 expref: 3 pid: 12058 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710892.009541:0:5833:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c51c71c8800, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1790710892.009556:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710892.009558:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710892.009560:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790710892.011504:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710892.011572:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710892.011785:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158208640 00000100:00100000:3.0:1790710892.011793:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158208640 00000100:00100000:3.0:1790710892.011890:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158208896 00000100:00100000:3.0:1790710892.011895:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158208896 00000100:00100000:0.0:1790710892.011942:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 19 00000100:00100000:0.0:1790710892.011952:0:8449:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8e8d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b75d7a5-152f-4db9-bf19-5fe279a322e3+13:2358:x1877696158208640:12345-192.168.206.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790710892.011967:0:8449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790710892.011983:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c51c8047600/0xcbad34b281570d7a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000352 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710892.011998:0:8449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790710892.012060:0:8449:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8e8d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b75d7a5-152f-4db9-bf19-5fe279a322e3+12:2358:x1877696158208640:12345-192.168.206.46@tcp:103:ldlm_bl.0 Request processed in 109us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710892.012067:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 19 00000100:00100000:0.0:1790710892.012083:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 20 00000100:00100000:0.0:1790710892.012088:0:8449:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8e8e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b75d7a5-152f-4db9-bf19-5fe279a322e3+11:2358:x1877696158208896:12345-192.168.206.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790710892.012097:0:8449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790710892.012107:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c51c0030800/0xcbad34b281570f8e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700041d expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710892.012116:0:8449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790710892.012171:0:8449:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8e8e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b75d7a5-152f-4db9-bf19-5fe279a322e3+10:2358:x1877696158208896:12345-192.168.206.46@tcp:103:ldlm_bl.0 Request processed in 81us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710892.012178:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 20 00000100:00100000:3.0:1790710892.016794:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710892.016990:0:12058:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158209024 00000100:00100000:2.0:1790710892.017000:0:12058:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158209024 00000100:00100000:2.0:1790710892.017078:0:12058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 73 00000100:00100000:2.0:1790710892.017089:0:12058:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c75dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+5:2355:x1877696158209024:12345-192.168.206.46@tcp:9:umount.0 00000020:00000080:2.0:1790710892.017117:0:12058:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcbad34b281571052 00000100:00080000:2.0:1790710892.017161:0:12058:0:(import.c:65:import_set_state_nolock()) ffff9c51ca7dd000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790710892.017203:0:12058:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:2.0:1790710892.017469:0:12058:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c75dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ec73bd1-726e-4dc0-8edd-807d3f973d65+2:2355:x1877696158209024:12345-192.168.206.46@tcp:9:umount.0 Request processed in 382us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710892.017487:0:12058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 73 00010000:00010000:1.0:1790710892.018004:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790710892.018357:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790710892.036013:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710892.036107:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158210048 00000100:00100000:1.0:1790710892.036116:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158210048 00000100:00100000:1.0:1790710892.036195:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 239 00000100:00100000:1.0:1790710892.036204:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8e8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+22:2355:x1877696158210048:12345-192.168.206.46@tcp:39:umount.0 00000020:00000080:1.0:1790710892.036235:0:5847:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcbad34b281570cee 00000020:00010000:1.0:1790710892.036248:0:5847:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9c51c8181000: total 0 00000100:00080000:1.0:1790710892.036253:0:5847:0:(import.c:65:import_set_state_nolock()) ffff9c51f49af000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790710892.036279:0:5847:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:1.0:1790710892.036652:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8e8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec73bd1-726e-4dc0-8edd-807d3f973d65+21:2355:x1877696158210048:12345-192.168.206.46@tcp:39:umount.0 Request processed in 448us (646us total) trans 4294967526 rc 0/0 00000100:00100000:1.0:1790710892.036661:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 239 00000020:00010000:2.0:1790710892.037198:0:8509:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9c51c8181000: total 0 00010000:00010000:2.0:1790710892.037252:0:8509:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c51c8181000, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1790710892.037287:0:8509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c51c2c2e800) 00010000:00010000:2.0:1790710892.037290:0:8509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790710892.037299:0:8509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047a00/0xcbad34b281571bc7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700076c expref: 20 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710892.037336:0:8509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c51cca25000) 00010000:00010000:2.0:1790710892.037338:0:8509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1790710892.037342:0:8509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047000/0xcbad34b2815716c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700060e expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710892.037354:0:8509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c51e4efb800) 00010000:00010000:2.0:1790710892.037357:0:8509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790710892.037361:0:8509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481a00/0xcbad34b281571617 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570005dd expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710892.037372:0:8509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c51e4efb800) 00010000:00010000:2.0:1790710892.037374:0:8509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1790710892.037378:0:8509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243a600/0xcbad34b281571641 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570005eb expref: 17 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710892.037389:0:8509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c51c2c2ec00) 00010000:00010000:2.0:1790710892.037392:0:8509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790710892.037395:0:8509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b2815716aa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000607 expref: 16 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710892.037406:0:8509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c51c2c2ee00) 00010000:00010000:2.0:1790710892.037409:0:8509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790710892.037412:0:8509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645400/0xcbad34b281571315 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000519 expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710892.037424:0:8509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c51c2c2e500) 00010000:00010000:2.0:1790710892.037426:0:8509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790710892.037436:0:8509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216b400/0xcbad34b281570fb8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700042b expref: 14 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710892.037454:0:8509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c51e4efb800) 00010000:00010000:2.0:1790710892.037456:0:8509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790710892.037460:0:8509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645000/0xcbad34b281571537 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570005a5 expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710892.037473:0:8509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c51c2c2e800) 00010000:00010000:2.0:1790710892.037475:0:8509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790710892.037479:0:8509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c6481400/0xcbad34b281571ca7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570007a4 expref: 12 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710892.037490:0:8509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c51c2c2ee00) 00010000:00010000:2.0:1790710892.037492:0:8509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1790710892.037496:0:8509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c520216a800/0xcbad34b281571028 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000447 expref: 11 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710892.037511:0:8509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c51c2c2e800) 00010000:00010000:2.0:1790710892.037513:0:8509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1790710892.037517:0:8509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243ba00/0xcbad34b281571cd1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570007b2 expref: 10 pid: 8060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710892.037532:0:8509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c51cca25300) 00010000:00010000:2.0:1790710892.037534:0:8509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790710892.037538:0:8509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8046a00/0xcbad34b281570fd4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000432 expref: 9 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710892.037552:0:8509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c51cca25000) 00010000:00010000:2.0:1790710892.037560:0:8509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790710892.037565:0:8509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c243b200/0xcbad34b2815719a5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570006e0 expref: 8 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710892.037578:0:8509:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c51c8181000, canceled 13 locks, left on hash table 0. 00010000:00010000:2.0:1790710892.037593:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710892.037596:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710892.037597:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710892.040069:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790710892.296642:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790710892.296663:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51d03fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1877696177062912:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790710892.296728:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710892.296852:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177062912 00000100:00100000:2.0:1790710892.296861:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177062912 00000100:00100000:2.0:1790710892.296922:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1790710892.296939:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c50c35b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877696177062912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790710892.296972:0:6699:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790710892.297030:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c50c35b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877696177062912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710892.297038:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1790710892.297088:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51d03fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1877696177062912:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790710892.514861:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710892.514914:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710892.515119:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158210304 00000100:00100000:1.0:1790710892.515170:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158210304 00000100:00100000:0.0:1790710892.515308:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158210176 00000100:00100000:0.0:1790710892.515313:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158210176 00000100:00100000:0.0:1790710892.515368:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 303 00000100:00100000:0.0:1790710892.515377:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8ffb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b75d7a5-152f-4db9-bf19-5fe279a322e3+10:2357:x1877696158210176:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:0.0:1790710892.515456:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8ffb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b75d7a5-152f-4db9-bf19-5fe279a322e3+10:2357:x1877696158210176:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 80us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710892.515465:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 303 00000100:00100000:1.0:1790710892.516528:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 168 00000100:00100000:1.0:1790710892.516542:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d03fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1b59f23d-9a5c-439d-bd4a-453bf2315b97+6:2357:x1877696158210304:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:1.0:1790710892.516614:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d03fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1b59f23d-9a5c-439d-bd4a-453bf2315b97+6:2357:x1877696158210304:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 76us (1699us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710892.516621:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 168 00000100:00080000:3.0:1790710892.523628:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1790710893.063781:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1790710893.374848:0:6720:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0ec73bd1-726e-4dc0-8edd-807d3f973d65 00000020:00000080:2.0:1790710893.374857:0:6720:0:(genops.c:885:class_export_put()) final put ffff9c51ca7d8000/0ec73bd1-726e-4dc0-8edd-807d3f973d65 00000020:00000080:1.0:1790710893.375207:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9c51ca7d8000/0ec73bd1-726e-4dc0-8edd-807d3f973d65 for lustre-OST0000 00000020:00000080:1.0:1790710893.375310:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c51ca7dd000 for lustre-OST0000 00000100:00100000:2.0:1790710893.845169:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710893.845214:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710893.845257:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710893.845353:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158210432 00000100:00100000:3.0:1790710893.845371:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158210432 00000100:00100000:0.0:1790710893.845420:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158210688 00000100:00100000:0.0:1790710893.845432:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158210688 00000100:00100000:3.0:1790710893.845474:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158210560 00000100:00100000:0.0:1790710893.845491:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 21 00000100:00100000:3.0:1790710893.845499:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158210560 00000100:00100000:0.0:1790710893.845508:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d03f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b75d7a5-152f-4db9-bf19-5fe279a322e3+12:2357:x1877696158210432:12345-192.168.206.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790710893.845527:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1790710893.845539:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 22 00010000:00010000:0.0:1790710893.845551:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c51c1644e00/0xcbad34b281570dc0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000367 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710893.845566:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d03fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b75d7a5-152f-4db9-bf19-5fe279a322e3+12:2357:x1877696158210688:12345-192.168.206.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790710893.845576:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790710893.845593:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790710893.845617:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c520216b000/0xcbad34b281570f6b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000416 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710893.845642:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d03f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b75d7a5-152f-4db9-bf19-5fe279a322e3+10:2357:x1877696158210432:12345-192.168.206.46@tcp:103:ldlm_bl.0 Request processed in 131us (473us total) trans 0 rc 0/0 00010000:00010000:3.0:1790710893.845651:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790710893.845653:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 21 00000100:00100000:0.0:1790710893.845680:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 23 00000100:00100000:3.0:1790710893.845719:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d03fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b75d7a5-152f-4db9-bf19-5fe279a322e3+9:2357:x1877696158210688:12345-192.168.206.46@tcp:103:ldlm_bl.0 Request processed in 158us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710893.845720:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d03f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b75d7a5-152f-4db9-bf19-5fe279a322e3+9:2357:x1877696158210560:12345-192.168.206.46@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1790710893.845747:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 22 00010000:00010000:0.0:1790710893.845751:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790710893.845770:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c51c1645a00/0xcbad34b281570dc7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000391 expref: 8 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710893.845784:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790710893.845810:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d03f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b75d7a5-152f-4db9-bf19-5fe279a322e3+7:2357:x1877696158210560:12345-192.168.206.46@tcp:103:ldlm_bl.0 Request processed in 107us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710893.845817:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 23 00000100:00100000:2.0:1790710893.856000:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710893.856099:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158210944 00000100:00100000:1.0:1790710893.856110:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158210944 00000100:00100000:1.0:1790710893.856204:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 240 00000100:00100000:1.0:1790710893.856238:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f8ce4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1b59f23d-9a5c-439d-bd4a-453bf2315b97+6:2355:x1877696158210944:12345-192.168.206.46@tcp:39:umount.0 00000020:00000080:1.0:1790710893.856276:0:5847:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcbad34b281570dd5 00000020:00010000:1.0:1790710893.856285:0:5847:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9c51f49a8000: total 0 00000100:00080000:1.0:1790710893.856289:0:5847:0:(import.c:65:import_set_state_nolock()) ffff9c51f49aa800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790710893.856319:0:5847:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000020:00010000:2.0:1790710893.856651:0:8509:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9c51f49a8000: total 0 00010000:00010000:2.0:1790710893.856656:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710893.856717:0:8509:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c51f49a8000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1790710893.856747:0:8509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c51c2c2ec00) 00010000:00010000:2.0:1790710893.856750:0:8509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790710893.856758:0:8509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c8047800/0xcbad34b281571cf4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570007c0 expref: 6 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710893.856778:0:8509:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c51f49a8000, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1790710893.856789:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710893.856790:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710893.856792:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790710893.856970:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f8ce4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1b59f23d-9a5c-439d-bd4a-453bf2315b97+3:2355:x1877696158210944:12345-192.168.206.46@tcp:39:umount.0 Request processed in 734us (978us total) trans 4294967527 rc 0/0 00000100:00100000:1.0:1790710893.856978:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 240 00000100:00100000:2.0:1790710893.893296:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710893.893386:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158211200 00000100:00100000:3.0:1790710893.893396:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158211200 00000100:00100000:3.0:1790710893.893502:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 304 00000100:00100000:3.0:1790710893.893512:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8ffac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b75d7a5-152f-4db9-bf19-5fe279a322e3+7:2355:x1877696158211200:12345-192.168.206.46@tcp:251:umount.0 00000020:00000080:3.0:1790710893.893557:0:5840:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcbad34b281570ccb 00000020:00010000:3.0:1790710893.893564:0:5840:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9c51ff4b5800: total 0 00000100:00080000:3.0:1790710893.893568:0:5840:0:(import.c:65:import_set_state_nolock()) ffff9c51ff4b1800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1790710893.893828:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8ffac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b75d7a5-152f-4db9-bf19-5fe279a322e3+3:2355:x1877696158211200:12345-192.168.206.46@tcp:251:umount.0 Request processed in 316us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710893.893836:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 304 00000020:00010000:2.0:1790710893.894038:0:5833:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9c51ff4b5800: total 0 00010000:00010000:2.0:1790710893.894079:0:5833:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c51ff4b5800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1790710893.894107:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c51c6481e00/0xcbad34b281570d81 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000359 expref: 2 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710893.894121:0:5833:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c51ff4b5800, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1790710893.894176:0:5833:0:(genops.c:885:class_export_put()) final put ffff9c51ff4b5800/2b75d7a5-152f-4db9-bf19-5fe279a322e3 00010000:00010000:2.0:1790710893.894186:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710893.894188:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710893.894190:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1790710893.894269:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9c51ff4b5800/2b75d7a5-152f-4db9-bf19-5fe279a322e3 for MGS 00000020:00000080:0.0:1790710893.894319:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c51ff4b1800 for MGS 00010000:00010000:1.0:1790710894.087243:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1790710894.418400:0:7643:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0ec73bd1-726e-4dc0-8edd-807d3f973d65 00000020:00000080:0.0:1790710894.418408:0:7643:0:(genops.c:885:class_export_put()) final put ffff9c51c71c8800/0ec73bd1-726e-4dc0-8edd-807d3f973d65 00000020:00000080:0.0:1790710894.418450:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c51c71c8800/0ec73bd1-726e-4dc0-8edd-807d3f973d65 for lustre-OST0001 00000020:00000080:0.0:1790710894.418493:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c51c71c8000 for lustre-OST0001 00000001:00100000:3.0:1790710894.429285:0:5867:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1b59f23d-9a5c-439d-bd4a-453bf2315b97 00000001:00080000:3.0:1790710894.429301:0:5867:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:3.0:1790710894.429305:0:5867:0:(genops.c:885:class_export_put()) final put ffff9c51f49a8000/1b59f23d-9a5c-439d-bd4a-453bf2315b97 00000001:00100000:3.0:1790710894.429320:0:5867:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0ec73bd1-726e-4dc0-8edd-807d3f973d65 00000001:00080000:3.0:1790710894.429325:0:5867:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:3.0:1790710894.429339:0:5867:0:(genops.c:885:class_export_put()) final put ffff9c51c8181000/0ec73bd1-726e-4dc0-8edd-807d3f973d65 00000020:00000080:0.0:1790710894.434636:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9c51f49a8000/1b59f23d-9a5c-439d-bd4a-453bf2315b97 for lustre-MDT0000 00000020:00000080:0.0:1790710894.438236:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9c51c8181000/0ec73bd1-726e-4dc0-8edd-807d3f973d65 for lustre-MDT0000 00000020:00000080:0.0:1790710894.438303:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c51f49aa800 for lustre-MDT0000 00000020:00000080:0.0:1790710894.438309:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c51f49af000 for lustre-MDT0000 00010000:00010000:2.0:1790710895.111339:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1790710895.645424:0:13064:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1790710895.658259:0:13064:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1790710895.658306:0:13064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c6480600/0xcbad34b281570d50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570d57 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710895.658321:0:13064:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c6480600/0xcbad34b281570d50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbad34b281570d57 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710895.658330:0:13064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c6480600/0xcbad34b281570d50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xcbad34b281570d57 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710895.658337:0:13064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.146@tcp lock: ffff9c51c6480600/0xcbad34b281570d50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xcbad34b281570d57 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710895.658356:0:13064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1790710895.658361:0:13064:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1790710895.658380:0:13064:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790710895.658384:0:13064:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1790710895.658389:0:13064:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00010000:00010000:2.0:1790710895.658498:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790710895.658505:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.146@tcp lock: ffff9c51c6480600/0xcbad34b281570d50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xcbad34b281570d57 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710895.658512:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c6480600 already unused, calling callback (ffffffffc1cdfc20) 10000000:00010000:2.0:1790710895.658515:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.146@tcp lock: ffff9c51c6480600/0xcbad34b281570d50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xcbad34b281570d57 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710895.658540:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.146@tcp lock: ffff9c51c6480600/0xcbad34b281570d50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xcbad34b281570d57 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790710895.658547:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.146@tcp lock: ffff9c51c6480600/0xcbad34b281570d50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xcbad34b281570d57 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790710895.658552:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1790710895.658555:0:5833:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1790710895.658557:0:5833:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1790710895.658589:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.146@tcp lock: ffff9c51c6480600/0xcbad34b281570d50 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xcbad34b281570d57 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710895.658596:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790710895.658632:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.146@tcp lock: ffff9c51c6480600/0xcbad34b281570d50 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xcbad34b281570d57 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710895.658639:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.146@tcp lock: ffff9c51c6480600/0xcbad34b281570d50 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xcbad34b281570d57 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710895.658651:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710895.658653:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710895.658655:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790710895.658663:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790710895.658682:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d27fc27-b651-404a-bd8c-b798806fb18a:3312:1877696177063040:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790710895.658746:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710895.658802:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177063040 00000100:00100000:1.0:1790710895.658810:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177063040 00000100:00100000:2.0:1790710895.658923:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790710895.658939:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d62d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d27fc27-b651-404a-bd8c-b798806fb18a+19:3312:x1877696177063040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790710895.658957:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790710895.658978:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c51c0030a00/0xcbad34b281570d57 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcbad34b281570d50 expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710895.658990:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790710895.659105:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d62d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d27fc27-b651-404a-bd8c-b798806fb18a+18:3312:x1877696177063040:12345-0@lo:103:ldlm_bl.0 Request processed in 168us (358us total) trans 0 rc 0/0 00000100:00080000:0.0:1790710895.659156:0:13064:0:(import.c:65:import_set_state_nolock()) ffff9c51f6879800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1790710895.662201:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c50c35b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877696177063168:0@lo:39:umount.0 00000100:00100000:0.0:1790710895.662356:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710895.662477:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d27fc27-b651-404a-bd8c-b798806fb18a:3312:1877696177063040:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790710895.663217:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177063168 00000100:00100000:1.0:1790710895.663226:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177063168 00000100:00100000:1.0:1790710895.663335:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1790710895.663345:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c50c35b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1877696177063168:12345-0@lo:39:umount.0 00000020:00000080:1.0:1790710895.663374:0:5846:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcbad34b281570ada 00000100:00080000:1.0:1790710895.663383:0:5846:0:(import.c:65:import_set_state_nolock()) ffff9c51f8c96800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1790710895.663456:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c50c35b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3308:x1877696177063168:12345-0@lo:39:umount.0 Request processed in 113us (1100us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710895.663464:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000020:00000080:1.0:1790710895.663475:0:5846:0:(genops.c:885:class_export_put()) final put ffff9c51f8c97800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:1.0:1790710895.663789:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1790710895.663799:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c51f8c97800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1790710895.663913:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c51f8c96800 for lustre-MDT0000 00000100:00080000:1.0:1790710895.663945:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9c51f6879800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1790710895.663964:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c50c35b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877696177063168:0@lo:39:umount.0 00000100:00080000:0.0:1790710895.663996:0:13064:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790710895.664011:0:13064:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1790710895.664016:0:13064:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1790710895.665034:0:13064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c0030400/0xcbad34b281570d5e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570d65 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710895.665944:0:13064:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c0030400/0xcbad34b281570d5e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbad34b281570d65 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710895.665953:0:13064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c0030400/0xcbad34b281570d5e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xcbad34b281570d65 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710895.665960:0:13064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.146@tcp lock: ffff9c51c0030400/0xcbad34b281570d5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xcbad34b281570d65 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710895.666051:0:13064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790710895.666060:0:13064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c8047c00/0xcbad34b281570c85 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570c8c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710895.666067:0:13064:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c8047c00/0xcbad34b281570c85 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbad34b281570c8c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710895.666074:0:13064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c8047c00/0xcbad34b281570c85 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcbad34b281570c8c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710895.666080:0:13064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.146@tcp lock: ffff9c51c8047c00/0xcbad34b281570c85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcbad34b281570c8c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710895.666236:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:3.0:1790710895.670982:0:8509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790710895.670997:0:8509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.146@tcp lock: ffff9c51c0030400/0xcbad34b281570d5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xcbad34b281570d65 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710895.671018:0:8509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c0030400 already unused, calling callback (ffffffffc1cdfc20) 10000000:00010000:3.0:1790710895.671023:0:8509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.146@tcp lock: ffff9c51c0030400/0xcbad34b281570d5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xcbad34b281570d65 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710895.671033:0:8509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.146@tcp lock: ffff9c51c0030400/0xcbad34b281570d5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xcbad34b281570d65 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790710895.671040:0:8509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.146@tcp lock: ffff9c51c0030400/0xcbad34b281570d5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xcbad34b281570d65 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790710895.671055:0:8509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1790710895.671058:0:8509:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1790710895.671098:0:8509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.146@tcp lock: ffff9c51c0030400/0xcbad34b281570d5e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xcbad34b281570d65 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710895.671105:0:8509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790710895.671149:0:8509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.146@tcp lock: ffff9c51c0030400/0xcbad34b281570d5e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xcbad34b281570d65 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710895.671157:0:8509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.146@tcp lock: ffff9c51c0030400/0xcbad34b281570d5e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xcbad34b281570d65 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710895.671172:0:8509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790710895.671176:0:8509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.146@tcp lock: ffff9c51c8047c00/0xcbad34b281570c85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcbad34b281570c8c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710895.671180:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c75dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d27fc27-b651-404a-bd8c-b798806fb18a:3312:1877696177063296:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790710895.671181:0:8509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c8047c00 already unused, calling callback (ffffffffc1cdfc20) 10000000:00010000:3.0:1790710895.671196:0:8509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.146@tcp lock: ffff9c51c8047c00/0xcbad34b281570c85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcbad34b281570c8c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710895.671203:0:8509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.146@tcp lock: ffff9c51c8047c00/0xcbad34b281570c85 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xcbad34b281570c8c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790710895.671208:0:8509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.146@tcp lock: ffff9c51c8047c00/0xcbad34b281570c85 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xcbad34b281570c8c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790710895.671213:0:8509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1790710895.671215:0:8509:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:3.0:1790710895.671226:0:8509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.146@tcp lock: ffff9c51c8047c00/0xcbad34b281570c85 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcbad34b281570c8c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710895.671243:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790710895.671245:0:8509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790710895.671259:0:8509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.146@tcp lock: ffff9c51c8047c00/0xcbad34b281570c85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcbad34b281570c8c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710895.671266:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790710895.671267:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790710895.671269:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790710895.671279:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c75de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d27fc27-b651-404a-bd8c-b798806fb18a:3309:1877696177063424:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790710895.671301:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177063296 00000100:00100000:3.0:1790710895.671306:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710895.671309:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177063296 00000100:00100000:3.0:1790710895.671335:0:8449:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177063424 00000100:00100000:3.0:1790710895.671339:0:8449:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177063424 00000100:00100000:2.0:1790710895.671350:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790710895.671357:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8e5f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d27fc27-b651-404a-bd8c-b798806fb18a+19:3312:x1877696177063296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790710895.671369:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790710895.671381:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c51c8046600/0xcbad34b281570d65 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcbad34b281570d5e expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710895.671395:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790710895.672020:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8e5f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d27fc27-b651-404a-bd8c-b798806fb18a+18:3312:x1877696177063296:12345-0@lo:103:ldlm_bl.0 Request processed in 661us (774us total) trans 0 rc 0/0 00010000:00010000:0.0:1790710895.672478:0:13064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1790710895.672487:0:13064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.146@tcp lock: ffff9c51c8047c00/0xcbad34b281570c85 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcbad34b281570c8c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790710895.672503:0:13064:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1790710895.672512:0:13064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c6481800/0xcbad34b281570f80 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570f87 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710895.672521:0:13064:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c6481800/0xcbad34b281570f80 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbad34b281570f87 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710895.672529:0:13064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c6481800/0xcbad34b281570f80 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcbad34b281570f87 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710895.672536:0:13064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.146@tcp lock: ffff9c51c6481800/0xcbad34b281570f80 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcbad34b281570f87 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710895.672550:0:13064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790710895.672556:0:13064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c520216ac00/0xcbad34b281570a39 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570a40 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710895.672562:0:13064:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c520216ac00/0xcbad34b281570a39 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbad34b281570a40 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710895.672568:0:13064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c520216ac00/0xcbad34b281570a39 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcbad34b281570a40 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710895.672575:0:13064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.146@tcp lock: ffff9c520216ac00/0xcbad34b281570a39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcbad34b281570a40 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710895.672601:0:13064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1790710895.672605:0:13064:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1790710895.672608:0:13064:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1790710895.672633:0:13064:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1790710895.672637:0:13064:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1790710895.672642:0:13064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790710895.672647:0:13064:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1790710895.672652:0:13064:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9c51c64a7000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790710895.672657:0:13064:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9c51ff4b2000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790710895.672662:0:13064:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff9c51fa3d3380) has exports, disconnecting them 00000020:00080000:0.0:1790710895.672666:0:13064:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c51c64a7000), last request at 1790710891 00000020:00000080:0.0:1790710895.672673:0:13064:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcbad34b281570c4d 00000100:00080000:0.0:1790710895.672688:0:13064:0:(import.c:65:import_set_state_nolock()) ffff9c51c64a3800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1790710895.672727:0:13064:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c51c64a7000): rc 0 00000020:00000080:0.0:1790710895.672730:0:13064:0:(genops.c:885:class_export_put()) final put ffff9c51c64a7000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1790710895.672739:0:13064:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c51ff4b2000), last request at 1790710891 00000020:00000080:0.0:1790710895.672742:0:13064:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcbad34b281570b82 00000100:00080000:0.0:1790710895.672746:0:13064:0:(import.c:65:import_set_state_nolock()) ffff9c51ff4b3800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1790710895.672752:0:13064:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c51ff4b2000): rc 0 00000020:00000080:0.0:1790710895.672754:0:13064:0:(genops.c:885:class_export_put()) final put ffff9c51ff4b2000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:0.0:1790710895.672761:0:13064:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb1c780d7fae0 00000100:00080000:0.0:1790710895.672777:0:13064:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1790710895.672780:0:13064:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:0.0:1790710895.672791:0:13064:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1790710895.672861:0:13064:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1790710895.672877:0:13064:0:(import.c:65:import_set_state_nolock()) ffff9c51f4bc6000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1790710895.672890:0:13064:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1790710895.672897:0:13064:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:0.0:1790710895.672905:0:13064:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1790710895.672965:0:13064:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1790710895.672974:0:13064:0:(import.c:65:import_set_state_nolock()) ffff9c51f947b800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1790710895.672998:0:13064:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff9c51fa3d3380) has no exports 00010000:00010000:0.0:1790710895.673900:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790710895.673910:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.146@tcp lock: ffff9c51c6481800/0xcbad34b281570f80 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcbad34b281570f87 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710895.673920:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c6481800 already unused, calling callback (ffffffffc1cdfc20) 10000000:00010000:0.0:1790710895.673925:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.146@tcp lock: ffff9c51c6481800/0xcbad34b281570f80 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcbad34b281570f87 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710895.673935:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.146@tcp lock: ffff9c51c6481800/0xcbad34b281570f80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcbad34b281570f87 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790710895.673942:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.146@tcp lock: ffff9c51c6481800/0xcbad34b281570f80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcbad34b281570f87 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790710895.673948:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1790710895.673951:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1790710895.673953:0:5832:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1790710895.673984:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.146@tcp lock: ffff9c51c6481800/0xcbad34b281570f80 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xcbad34b281570f87 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710895.673990:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790710895.674022:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.146@tcp lock: ffff9c51c6481800/0xcbad34b281570f80 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xcbad34b281570f87 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710895.674030:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.146@tcp lock: ffff9c51c6481800/0xcbad34b281570f80 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xcbad34b281570f87 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710895.674091:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790710895.674107:0:8449:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c75dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5d27fc27-b651-404a-bd8c-b798806fb18a+18:3309:x1877696177063424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790710895.674114:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790710895.674120:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.146@tcp lock: ffff9c520216ac00/0xcbad34b281570a39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcbad34b281570a40 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710895.674122:0:8449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790710895.674147:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c520216ac00 already unused, calling callback (ffffffffc1cdfc20) 10000000:00010000:0.0:1790710895.674151:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.146@tcp lock: ffff9c520216ac00/0xcbad34b281570a39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcbad34b281570a40 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710895.674159:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c51c0031000/0xcbad34b281570c8c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcbad34b281570c85 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710895.674160:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.146@tcp lock: ffff9c520216ac00/0xcbad34b281570a39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xcbad34b281570a40 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790710895.674176:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.146@tcp lock: ffff9c520216ac00/0xcbad34b281570a39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xcbad34b281570a40 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790710895.674192:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1790710895.674195:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1790710895.674198:0:5832:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1790710895.674206:0:8449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790710895.674217:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.146@tcp lock: ffff9c520216ac00/0xcbad34b281570a39 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcbad34b281570a40 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710895.674225:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1790710895.674265:0:8449:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c75dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5d27fc27-b651-404a-bd8c-b798806fb18a+17:3309:x1877696177063424:12345-0@lo:103:ldlm_bl.0 Request processed in 163us (2957us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710895.674285:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:0.0:1790710895.674312:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.146@tcp lock: ffff9c520216ac00/0xcbad34b281570a39 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcbad34b281570a40 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710895.674318:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c50c35b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d27fc27-b651-404a-bd8c-b798806fb18a:3310:1877696177063808:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790710895.674324:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.146@tcp lock: ffff9c520216ac00/0xcbad34b281570a39 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcbad34b281570a40 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710895.674341:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790710895.674343:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790710895.674352:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790710895.674357:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1790710895.674363:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c51c64a7000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1790710895.674413:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c51ff4b2000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000100:00100000:3.0:1790710895.674435:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c75de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d27fc27-b651-404a-bd8c-b798806fb18a:3309:1877696177063424:0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1790710895.674446:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c51c64a3800 for lustre-MDT0000 00000020:00000080:0.0:1790710895.674452:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c51ff4b3800 for lustre-MDT0000 00010000:00010000:3.0:1790710895.674479:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790710895.674487:0:8449:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177063808 00000100:00100000:3.0:1790710895.674492:0:8449:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177063808 00000100:00100000:3.0:1790710895.674518:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790710895.674523:0:8449:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c75ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5d27fc27-b651-404a-bd8c-b798806fb18a+17:3310:x1877696177063808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790710895.674531:0:8449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790710895.674540:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c51c6480800/0xcbad34b281570f87 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcbad34b281570f80 expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710895.674549:0:8449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790710895.674675:0:8449:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c75ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5d27fc27-b651-404a-bd8c-b798806fb18a+16:3310:x1877696177063808:12345-0@lo:103:ldlm_bl.0 Request processed in 150us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710895.674683:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790710895.675220:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c50c35b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d27fc27-b651-404a-bd8c-b798806fb18a:3310:1877696177063808:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790710895.675533:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790710895.676166:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790710895.676398:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c50c35b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1877696177063552:0@lo:9:umount.0 00000100:00100000:0.0:1790710895.676447:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710895.676478:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c50c35b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1877696177063680:0@lo:9:umount.0 00000100:00100000:0.0:1790710895.676500:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710895.676531:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177063552 00000100:00100000:0.0:1790710895.676536:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177063552 00000100:00100000:0.0:1790710895.676582:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177063680 00000100:00080000:3.0:1790710895.676585:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790710895.676585:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177063680 00000100:00100000:2.0:1790710895.676622:0:12058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1790710895.676630:0:12058:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c50c35b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1877696177063552:12345-0@lo:9:umount.0 00000020:00000080:2.0:1790710895.676652:0:12058:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcbad34b281570bcf 00000100:00080000:2.0:1790710895.676659:0:12058:0:(import.c:65:import_set_state_nolock()) ffff9c51ff480000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790710895.676696:0:12058:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:3.0:1790710895.676890:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790710895.677305:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790710895.677341:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1790710895.677349:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c50c35b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1877696177063680:12345-0@lo:9:umount.0 00000020:00000080:0.0:1790710895.677362:0:6698:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcbad34b281570cb6 00000100:00080000:0.0:1790710895.677369:0:6698:0:(import.c:65:import_set_state_nolock()) ffff9c51f3c08800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1790710895.677380:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1790710895.677388:0:6698:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1790710895.677633:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c50c35b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3308:x1877696177063680:12345-0@lo:9:umount.0 Request processed in 285us (1131us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710895.677640:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1790710895.677728:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9c51f947b800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1790710895.677752:0:3308:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1790710895.677755:0:3308:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790710895.677759:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c50c35b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1877696177063680:0@lo:9:umount.0 00000100:00100000:1.0:1790710895.678161:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c75dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d27fc27-b651-404a-bd8c-b798806fb18a:3312:1877696177063296:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790710895.678182:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790710895.678191:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c50c35b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d27fc27-b651-404a-bd8c-b798806fb18a:3312:1877696177063936:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790710895.678290:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710895.678598:0:8449:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177063936 00000100:00100000:3.0:1790710895.678604:0:8449:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177063936 00000100:00100000:3.0:1790710895.678698:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790710895.678708:0:8449:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff87c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5d27fc27-b651-404a-bd8c-b798806fb18a+15:3312:x1877696177063936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790710895.678720:0:8449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790710895.678740:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c51c13fce00/0xcbad34b281570a40 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcbad34b281570a39 expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710895.678756:0:8449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790710895.678793:0:8449:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff87c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5d27fc27-b651-404a-bd8c-b798806fb18a+14:3312:x1877696177063936:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710895.678800:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790710895.679823:0:12058:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c50c35b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3308:x1877696177063552:12345-0@lo:9:umount.0 Request processed in 3191us (3372us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710895.679844:0:12058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:2.0:1790710895.679916:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9c51f4bc6000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1790710895.679928:0:3308:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1790710895.679930:0:3308:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790710895.679934:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c50c35b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1877696177063552:0@lo:9:umount.0 00000100:00100000:2.0:1790710895.680115:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c50c35b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d27fc27-b651-404a-bd8c-b798806fb18a:3312:1877696177063936:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1790710895.692457:0:13064:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff9c51fa3d3380) has no exports 00000020:00000080:1.0:1790710895.756107:0:13064:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcbad34b281570a94 00000020:00000080:1.0:1790710895.756124:0:13064:0:(genops.c:885:class_export_put()) final put ffff9c51c5d3c800/lustre-QMT0000_UUID 00000020:01000000:1.0:1790710895.756319:0:13064:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1790710895.756406:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c51c5d3c800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1790710895.756782:0:13064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790710895.756792:0:13064:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1790710895.756797:0:13064:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff9c51d02d4d40) has no exports 00000020:00000080:2.0:1790710895.757170:0:13064:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcbad34b281570a8d 00000020:00000080:2.0:1790710895.757177:0:13064:0:(genops.c:885:class_export_put()) final put ffff9c51c7e36000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1790710895.757340:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c51c7e36000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1790710895.757453:0:13064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790710895.757461:0:13064:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1790710895.757464:0:13064:0:(genops.c:885:class_export_put()) final put ffff9c51f3c0f800/lustre-QMT0000_UUID 00000020:00000080:2.0:1790710895.757467:0:13064:0:(genops.c:844:class_export_destroy()) destroying export ffff9c51f3c0f800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1790710895.757474:0:13064:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:2.0:1790710895.757596:0:13064:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9c51f4c08480 - data ffff9c51ffe27af8/ffff9c51f4532c00 00000020:01000000:2.0:1790710895.757728:0:13064:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9c51e4d4a5a0 - data ffff9c51ca3de000/ffff9c51fa3c0800 00000001:00000004:3.0:1790710895.772331:0:13064:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00080000:1.0:1790710895.885319:0:13064:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1790710895.885328:0:13064:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:1.0:1790710895.885340:0:13064:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1790710895.885343:0:13064:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1790710895.886306:0:7025:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1790710895.886311:0:7025:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:2.0:1790710895.886322:0:7025:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1790710895.887222:0:13064:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1790710895.887226:0:13064:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:1.0:1790710895.887238:0:13064:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1790710895.887241:0:13064:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1790710895.887632:0:8058:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1790710895.887636:0:8058:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:3.0:1790710895.887643:0:8058:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1790710895.963434:0:13064:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcbad34b281570a5c 00000020:00000080:1.0:1790710895.963448:0:13064:0:(genops.c:885:class_export_put()) final put ffff9c51fa3cc800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1790710895.963549:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c51fa3cc800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1790710895.964268:0:13064:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcbad34b281570a71 00000020:00000080:1.0:1790710895.964276:0:13064:0:(genops.c:885:class_export_put()) final put ffff9c51fa3ca000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1790710895.964292:0:13064:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1790710895.964298:0:13064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790710895.964306:0:13064:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1790710895.964311:0:13064:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff9c51fa3d4d40) has no exports 00000004:01000000:1.0:1790710895.964438:0:13064:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1790710895.964445:0:13064:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcbad34b281570caf 00000020:00000080:1.0:1790710895.964449:0:13064:0:(genops.c:885:class_export_put()) final put ffff9c51ff70f000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1790710895.964452:0:13064:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1790710895.964455:0:13064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790710895.964466:0:13064:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1790710895.964469:0:13064:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff9c51ff4a8000) has no exports 00000020:00000080:1.0:1790710895.964474:0:13064:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcbad34b281570ca8 00000020:00000080:3.0:1790710895.964483:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c51fa3ca000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1790710895.964488:0:13064:0:(genops.c:885:class_export_put()) final put ffff9c51f947e000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1790710895.964489:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c51ff70f000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:1.0:1790710895.964832:0:13064:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1790710895.964837:0:13064:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1790710895.964841:0:13064:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:1.0:1790710895.964846:0:13064:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1790710895.964848:0:13064:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1790710895.967204:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c51f947e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1790710895.970266:0:13064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790710895.970284:0:13064:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790710895.970291:0:13064:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcbad34b281570bc8 00000020:00000080:1.0:1790710895.970299:0:13064:0:(genops.c:885:class_export_put()) final put ffff9c51ff442000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1790710895.972480:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c51f947b800 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1790710895.972495:0:37:0:(genops.c:885:class_export_put()) final put ffff9c51ff70d000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1790710895.972498:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c51ff70d000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1790710895.972512:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1790710895.978828:0:13064:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1790710895.978843:0:13064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790710895.978862:0:13064:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1790710895.978867:0:13064:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff9c51c81b8000) has no exports 00000020:00000080:1.0:1790710895.978874:0:13064:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcbad34b281570bc1 00000020:00000080:1.0:1790710895.978882:0:13064:0:(genops.c:885:class_export_put()) final put ffff9c51f4bc5000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1790710895.980942:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c51ff442000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:1.0:1790710895.981940:0:13064:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1790710895.981946:0:13064:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1790710895.981950:0:13064:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:1.0:1790710895.981956:0:13064:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1790710895.981959:0:13064:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1790710895.981992:0:13064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790710895.982097:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c51f4bc5000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1790710895.982107:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c51f4bc6000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1790710895.982175:0:13064:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790710895.982181:0:13064:0:(genops.c:885:class_export_put()) final put ffff9c51ff443000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1790710895.982183:0:13064:0:(genops.c:844:class_export_destroy()) destroying export ffff9c51ff443000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1790710895.982190:0:13064:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790710895.982386:0:13064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790710895.982390:0:13064:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790710895.982393:0:13064:0:(genops.c:885:class_export_put()) final put ffff9c51f8c90800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1790710895.982395:0:13064:0:(genops.c:844:class_export_destroy()) destroying export ffff9c51f8c90800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1790710895.982399:0:13064:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790710895.982500:0:13064:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcbad34b281570a78 00000020:00000080:1.0:1790710895.982506:0:13064:0:(genops.c:885:class_export_put()) final put ffff9c51fa3cb800/lustre-MDD0000_UUID 00000020:01000000:1.0:1790710895.982552:0:13064:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1790710895.982557:0:13064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790710895.982562:0:13064:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1790710895.982573:0:13064:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff9c51fa3d0000) has no exports 00000020:00000080:1.0:1790710895.982592:0:13064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790710895.982595:0:13064:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1790710895.982598:0:13064:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcbad34b281570a7f 00000020:00000080:1.0:1790710895.982601:0:13064:0:(genops.c:885:class_export_put()) final put ffff9c51fa3cf000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1790710895.986742:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c51fa3cb800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1790710895.986755:0:37:0:(genops.c:885:class_export_put()) final put ffff9c51fa3cb000/lustre-MDD0000_UUID 00000020:00000080:2.0:1790710895.986758:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c51fa3cb000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1790710895.986765:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:1.0:1790710895.997497:0:13064:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c51c67ea000 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1790710895.997506:0:13064:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c51c67ea000 3 00000020:01000004:1.0:1790710895.997510:0:13064:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c51c67ea000 from lustre-MDT0000 00000020:00000080:1.0:1790710895.997540:0:13064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790710895.997549:0:13064:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1790710895.997553:0:13064:0:(genops.c:885:class_export_put()) final put ffff9c51fa3cd800/lustre-MDT0000_UUID 00000020:00000080:1.0:1790710895.997557:0:13064:0:(genops.c:844:class_export_destroy()) destroying export ffff9c51fa3cd800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1790710895.997569:0:13064:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:00000080:3.0:1790710895.997578:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c51fa3cf000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:1.0:1790710895.997630:0:13064:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:1.0:1790710895.997633:0:13064:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1790710895.997636:0:13064:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1790710895.997641:0:13064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790710895.997644:0:13064:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1790710895.997651:0:13064:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff9c51d02df800 5d27fc27-b651-404a-bd8c-b798806fb18a 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1790710895.997658:0:13064:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff9c51d02d0000) has exports, disconnecting them 00000020:00080000:1.0:1790710895.997662:0:13064:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9c51d02df800), last request at 1790710676 00000020:00000080:1.0:1790710895.997675:0:13064:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcbad34b281570a1d 00000020:00010000:1.0:1790710895.997680:0:13064:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9c51d02df800: total 0 00000100:00080000:1.0:1790710895.997684:0:13064:0:(import.c:65:import_set_state_nolock()) ffff9c51d02de000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1790710895.998458:0:13064:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c51d02df800): rc 0 00000020:00080000:1.0:1790710895.998464:0:13064:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff9c51d02d0000) has no exports 00000020:00010000:3.0:1790710895.998585:0:5833:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9c51d02df800: total 0 00010000:00010000:3.0:1790710895.998629:0:5833:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c51d02df800, canceled 0 locks, left on hash table 8. 00010000:00010000:3.0:1790710895.998673:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c51c13fc800/0xcbad34b281570d3b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcbad34b281570d34 expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710895.998693:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c51c8047400/0xcbad34b281570d49 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcbad34b281570d42 expref: 8 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710895.998700:0:5838:0:(service.c:3206:ptlrpc_main()) ll_mgs_0001: service thread [ffff9c51c8ee8400:5838] 1 exiting: rc = 0 00010000:00010000:3.0:1790710895.998709:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c520216ba00/0xcbad34b281570f64 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcbad34b281570f5d expref: 7 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710895.998724:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c51c1644c00/0xcbad34b281570b35 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcbad34b281570b2e expref: 6 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710895.998743:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c51c13fd200/0xcbad34b281570d73 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcbad34b281570d6c expref: 5 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710895.998760:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c520216a000/0xcbad34b281570f79 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcbad34b281570f72 expref: 4 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710895.998782:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c51c6480a00/0xcbad34b281570d1f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcbad34b281570d18 expref: 3 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710895.998793:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c51c6481600/0xcbad34b281570d2d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcbad34b281570d26 expref: 2 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710895.998804:0:5833:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c51d02df800, canceled 8 locks, left on hash table 0. 00000020:00000080:3.0:1790710895.998816:0:5833:0:(genops.c:885:class_export_put()) final put ffff9c51d02df800/5d27fc27-b651-404a-bd8c-b798806fb18a 00010000:00010000:3.0:1790710895.998835:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790710895.998838:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790710895.998840:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790710895.998865:0:5840:0:(service.c:3206:ptlrpc_main()) ll_mgs_0002: service thread [ffff9c51c8ee9200:5840] 2 exiting: rc = 0 00000020:00000080:2.0:1790710895.998990:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c51d02df800/5d27fc27-b651-404a-bd8c-b798806fb18a for MGS 00000020:00000080:2.0:1790710895.999038:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c51d02de000 for MGS 00000100:00100000:0.0:1790710896.000859:0:5837:0:(service.c:3206:ptlrpc_main()) ll_mgs_0000: service thread [ffff9c51c8ee9600:5837] 0 exiting: rc = 1 00000100:00100000:3.0:1790710896.003481:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790710896.003506:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790710896.003512:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790710896.003518:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790710896.003523:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790710896.003530:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790710896.003535:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790710896.003542:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790710896.003547:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790710896.003553:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790710896.003558:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790710896.003563:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790710896.003569:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790710896.003575:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790710896.003580:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790710896.003587:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790710896.003593:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790710896.003599:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790710896.003604:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790710896.003610:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790710896.003615:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790710896.003621:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790710896.003627:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790710896.003632:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790710896.003637:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790710896.003643:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790710896.003648:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790710896.003654:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790710896.003659:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790710896.003666:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790710896.003670:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790710896.003675:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790710896.003680:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790710896.003685:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790710896.003691:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790710896.003696:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790710896.003709:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790710896.003714:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790710896.003719:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790710896.003724:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790710896.003729:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790710896.003734:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790710896.003739:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790710896.003744:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790710896.003749:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790710896.003753:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790710896.003758:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790710896.003763:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790710896.003767:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790710896.003771:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790710896.003775:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790710896.003780:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790710896.003784:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790710896.003789:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790710896.003793:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790710896.003798:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790710896.003803:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790710896.003808:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790710896.003812:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790710896.003817:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790710896.003822:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790710896.003827:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790710896.003832:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790710896.003836:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:3.0:1790710896.004237:0:13064:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1790710896.004240:0:13064:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:3.0:1790710896.004719:0:13064:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9c51f42d62a0 - data ffff9c51ffd1a5e8/ffff9c51f4df7000 00000020:01000000:3.0:1790710896.004817:0:13064:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9c51c65bc7e0 - data ffff9c51d7721d80/ffff9c51c7bd5000 00000020:00000080:3.0:1790710896.005271:0:13064:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcbad34b281570a01 00000020:00000080:3.0:1790710896.005278:0:13064:0:(genops.c:885:class_export_put()) final put ffff9c51c7e36800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1790710896.005301:0:13064:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c51c67ea000 from MGS, refs=2 00000020:01000004:3.0:1790710896.005311:0:13064:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c51c67ea000 2 00000020:01000004:3.0:1790710896.005315:0:13064:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c51c67ea000 from MGS 00000020:00000080:2.0:1790710896.005334:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c51c7e36800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1790710896.005338:0:13064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790710896.005345:0:13064:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1790710896.005348:0:13064:0:(genops.c:885:class_export_put()) final put ffff9c51c67ef000/MGS 00000020:00000080:3.0:1790710896.005350:0:13064:0:(genops.c:844:class_export_destroy()) destroying export ffff9c51c67ef000/MGS for MGS 00000020:01000000:3.0:1790710896.005357:0:13064:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1790710896.005406:0:13064:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1790710896.005410:0:13064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790710896.005415:0:13064:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1790710896.005422:0:13064:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9c51f8c95000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1790710896.005427:0:13064:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff9c51d02d3380) has exports, disconnecting them 00000020:00080000:3.0:1790710896.005431:0:13064:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9c51f8c95000), last request at 1790710678 00000020:00000080:3.0:1790710896.005434:0:13064:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcbad34b281570acc 00000020:00080000:3.0:1790710896.005440:0:13064:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c51f8c95000): rc 0 00000020:00000080:3.0:1790710896.005444:0:13064:0:(genops.c:885:class_export_put()) final put ffff9c51f8c95000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1790710896.005644:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c51f8c95000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1790710896.005957:0:13064:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1790710896.005961:0:13064:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790710896.005965:0:13064:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1790710896.005969:0:13064:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1790710896.006080:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c51f6879800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1790710896.006116:0:13064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790710896.006121:0:13064:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1790710896.006124:0:13064:0:(genops.c:885:class_export_put()) final put ffff9c51f687c800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1790710896.006147:0:13064:0:(genops.c:844:class_export_destroy()) destroying export ffff9c51f687c800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1790710896.010392:0:13064:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1790710896.010611:0:13064:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c51c67ea000 1 00000020:00000080:2.0:1790710896.010619:0:13064:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcbad34b2815709f3 00000020:00000080:2.0:1790710896.010626:0:13064:0:(genops.c:885:class_export_put()) final put ffff9c51c7d6c800/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1790710896.010647:0:13064:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1790710896.010652:0:13064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790710896.010660:0:13064:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1790710896.010664:0:13064:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff9c51c81bcd40) has no exports 00000020:00000080:1.0:1790710896.010719:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c51c7d6c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1790710896.050712:0:13064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790710896.051233:0:13064:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1790710896.051239:0:13064:0:(genops.c:885:class_export_put()) final put ffff9c51c67ec800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1790710896.051244:0:13064:0:(genops.c:844:class_export_destroy()) destroying export ffff9c51c67ec800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1790710896.051251:0:13064:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1790710896.051378:0:13064:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9c51c67ed800 00000020:01000000:1.0:1790710896.051400:0:13064:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1790710896.051404:0:13064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790710896.051408:0:13064:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1790710896.051411:0:13064:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff9c51c81bb380) has no exports 00000100:00100000:1.0:1790710896.051481:0:5847:0:(service.c:3206:ptlrpc_main()) mdt00_002: service thread [ffff9c51d0230200:5847] 2 exiting: rc = 0 00000100:00100000:1.0:1790710896.051650:0:5846:0:(service.c:3206:ptlrpc_main()) mdt00_001: service thread [ffff9c51c655de00:5846] 1 exiting: rc = 0 00000100:00100000:3.0:1790710896.053364:0:8060:0:(service.c:3206:ptlrpc_main()) mdt00_003: service thread [ffff9c51ccae4400:8060] 3 exiting: rc = 0 00000100:00100000:3.0:1790710896.053461:0:5845:0:(service.c:3206:ptlrpc_main()) mdt00_000: service thread [ffff9c51c7a6f600:5845] 0 exiting: rc = 1 00000100:00100000:1.0:1790710896.054104:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.054111:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.054118:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.054123:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.054143:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.054148:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.054155:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.054160:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.054166:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.054171:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.054176:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.054181:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.054187:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.054192:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.054197:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.054202:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.054208:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.054213:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.054218:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.054223:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.054228:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.054247:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.054252:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.054257:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.054263:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.054268:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.054273:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.054279:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.054284:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.054289:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.054295:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.054299:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.054304:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.054308:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.054313:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.054318:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.054323:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.054328:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.054333:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.054339:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.054345:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.054350:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.054356:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.054362:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.054366:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.054371:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.054376:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.054380:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.054385:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.054391:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.054396:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.054400:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.054405:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.054410:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.054416:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.054423:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.054439:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.054445:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.054450:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.054455:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.054460:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.054464:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.054469:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.054481:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.062022:0:5849:0:(service.c:3206:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9c51d0231000:5849] 1 exiting: rc = 0 00000100:00100000:2.0:1790710896.062123:0:5848:0:(service.c:3206:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9c51d0230600:5848] 0 exiting: rc = 1 00000100:00100000:1.0:1790710896.063720:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.063730:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.063737:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.063743:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.063748:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.063754:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.063762:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.063769:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.063774:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.063781:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.063786:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.063793:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.063799:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.063804:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.063809:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.063814:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.063819:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.063824:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.063829:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.063833:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.063838:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.063844:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.063849:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.063854:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.063861:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.063866:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.063872:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.063895:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.063900:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.063904:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.063910:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.063915:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.063919:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.063925:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.063931:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.063936:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.063942:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.063948:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.063954:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.063959:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.063964:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.063969:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.063974:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.063980:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.063985:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.063991:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.063996:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.064013:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.064018:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.064023:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.064028:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.064033:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.064038:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.064043:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.064048:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.064054:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.064059:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.064064:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.064069:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.064074:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.064079:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.064084:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.064098:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.064114:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.064689:0:5850:0:(service.c:3206:ptlrpc_main()) mdt_out00_000: service thread [ffff9c51c8128a00:5850] 0 exiting: rc = 1 00000100:00100000:0.0:1790710896.065989:0:5851:0:(service.c:3206:ptlrpc_main()) mdt_out00_001: service thread [ffff9c51d0230a00:5851] 1 exiting: rc = 0 00000100:00100000:1.0:1790710896.067792:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.067804:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.067810:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.067817:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.067824:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.067831:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.067838:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.067845:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.067852:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.067860:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.067867:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.067887:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.067894:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.067903:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.067909:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.067915:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.067920:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.067928:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.067935:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.067942:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.067948:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.067955:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.067961:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.067983:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.067991:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.068007:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.068015:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.068021:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.068027:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.068033:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.068040:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.068046:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.068052:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.068071:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.068077:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.068098:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.068105:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.068112:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.068118:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.068124:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.068154:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.068161:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.068167:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.068175:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.068181:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.068187:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.068196:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.068217:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.068225:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.068231:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.068237:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.068242:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.068248:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.068254:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.068259:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.068265:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.068271:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.068277:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.068284:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.068305:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.068313:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.068319:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.068326:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.068333:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.086345:0:5852:0:(service.c:3206:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9c51c8128800:5852] 0 exiting: rc = 1 00000100:00100000:1.0:1790710896.090025:0:5853:0:(service.c:3206:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9c51c8129c00:5853] 1 exiting: rc = 0 00000100:00100000:1.0:1790710896.090656:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.090665:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.090670:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.090689:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.090694:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.090699:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.090704:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.090708:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.090713:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.090718:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.090722:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.090727:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.090731:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.090735:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.090740:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.090744:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.090749:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.090754:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.090760:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.090765:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.090770:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.090775:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.090779:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.090785:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.090789:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.090793:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.090798:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.090803:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.090807:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.090812:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.090816:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.090822:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.090827:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.090832:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.090838:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.090842:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.090848:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.090852:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.090864:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.090869:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.090874:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.090878:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.090883:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.090888:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.090893:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.090898:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.090905:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.090909:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.090914:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.090919:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.090924:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.090928:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.090933:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.090938:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.090942:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.090948:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.090953:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.090958:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.090962:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.090967:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.090972:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.090977:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.090981:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.090986:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.091397:0:5854:0:(service.c:3206:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9c51c8128e00:5854] 0 exiting: rc = 1 00000100:00100000:2.0:1790710896.091581:0:5855:0:(service.c:3206:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9c51c8129000:5855] 1 exiting: rc = 0 00000100:00100000:2.0:1790710896.091631:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.091637:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.091642:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.091647:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.091651:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.091656:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.091661:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.091667:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.091682:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.091687:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.091692:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.091697:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.091701:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.091705:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.091710:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.091715:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.091719:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.091724:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.091728:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.091732:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.091736:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.091741:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.091746:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.091750:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.091754:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.091759:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.091763:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.091768:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.091773:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.091778:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.091783:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.091788:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.091792:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.091797:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.091802:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.091807:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.091812:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.091817:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.091822:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.091827:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.091833:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.091838:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.091842:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.091856:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.091860:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.091865:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.091871:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.091876:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.091881:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.091886:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.091892:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.091898:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.091903:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.091909:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.091915:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.091922:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.091930:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.091935:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.091945:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.091958:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.091964:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.091968:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.091972:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.091976:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.092274:0:5857:0:(service.c:3206:ptlrpc_main()) mdt_fld_0001: service thread [ffff9c51d03c8600:5857] 1 exiting: rc = 0 00000100:00100000:2.0:1790710896.092342:0:5856:0:(service.c:3206:ptlrpc_main()) mdt_fld_0000: service thread [ffff9c51c4eaee00:5856] 0 exiting: rc = 1 00000100:00100000:2.0:1790710896.092383:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.092389:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.092395:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.092399:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.092404:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.092410:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.092415:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.092419:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.092424:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.092429:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.092434:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.092439:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.092452:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.092458:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.092463:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.092467:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.092472:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.092476:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.092481:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.092486:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.092491:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.092497:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.092502:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.092508:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.092513:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.092518:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.092522:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.092526:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.092531:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.092535:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.092539:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.092544:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.092549:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.092554:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.092559:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.092564:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.092569:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.092573:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.092579:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.092584:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.092588:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.092593:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.092598:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.092602:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.092607:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.092613:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.092618:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.092632:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.092636:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.092641:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.092647:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.092651:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.092656:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.092661:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.092666:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.092672:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.092677:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.092682:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.092687:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.092691:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.092696:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.092701:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.092705:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710896.092710:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.093169:0:5859:0:(service.c:3206:ptlrpc_main()) mdt_io00_001: service thread [ffff9c51d03c8000:5859] 1 exiting: rc = 0 00000100:00100000:1.0:1790710896.093308:0:5860:0:(service.c:3206:ptlrpc_main()) mdt_io00_002: service thread [ffff9c51c732e400:5860] 2 exiting: rc = 0 00000100:00100000:2.0:1790710896.101656:0:5858:0:(service.c:3206:ptlrpc_main()) mdt_io00_000: service thread [ffff9c51d03c9000:5858] 0 exiting: rc = 1 00000100:00100000:1.0:1790710896.101816:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.101824:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.101848:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.101854:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.101859:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.101864:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.101885:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.101891:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.101896:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.101903:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.101909:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.101914:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.101919:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.101925:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.101930:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.101937:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.101942:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.101949:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.101955:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.101961:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.101966:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.101972:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.101978:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.101983:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.101989:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.101995:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.102029:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.102037:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.102042:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.102048:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.102053:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.102058:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.102064:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.102070:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.102076:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.102082:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.102087:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.102093:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.102099:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.102105:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.102110:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.102152:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.102160:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.102166:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.102172:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.102176:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.102182:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.102187:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.102192:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.102197:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.102217:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.102223:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.102228:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.102234:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.102239:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.102244:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.102249:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.102255:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.102260:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.102266:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.102271:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.102275:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.102281:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710896.102294:0:13064:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1790710896.111881:0:13064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790710896.111896:0:13064:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1790710896.111902:0:13064:0:(genops.c:885:class_export_put()) final put ffff9c51d0229000/MDS_uuid 00000020:00000080:1.0:1790710896.111906:0:13064:0:(genops.c:844:class_export_destroy()) destroying export ffff9c51d0229000/MDS_uuid for MDS 00000020:01000000:1.0:1790710896.111912:0:13064:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1790710896.112058:0:13064:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1790710896.138141:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790710896.391724:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790710896.391745:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51ff87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1877696177064064:0@lo:400:kworker.0 00000400:00000100:1.0:1790710896.391800:0:3311:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877696177064064 offset 0 length 224: 4 00000100:00100000:1.0:1790710896.392057:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51ff87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1877696177064192:0@lo:400:kworker.0 00000400:00000100:1.0:1790710896.392089:0:3309:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877696177064192 offset 0 length 224: 4 00010000:00010000:2.0:1790710897.165954:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790710898.183391:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1790710898.515112:0:6720:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1790710898.515121:0:6720:0:(genops.c:885:class_export_put()) final put ffff9c51ff481000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1790710898.515380:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c51ff481000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1790710898.515509:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c51ff480000 for lustre-OST0000 00000020:01000004:3.0:1790710898.871450:0:13214:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1790710898.885496:0:13214:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1790710898.885539:0:13214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c8047200/0xcbad34b281570d34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570d3b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710898.885553:0:13214:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c8047200/0xcbad34b281570d34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbad34b281570d3b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710898.885561:0:13214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c8047200/0xcbad34b281570d34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xcbad34b281570d3b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710898.885568:0:13214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.146@tcp lock: ffff9c51c8047200/0xcbad34b281570d34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xcbad34b281570d3b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710898.885591:0:13214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1790710898.885597:0:13214:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1790710898.885620:0:13214:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790710898.885631:0:13214:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c51ff87c700 x1877696177064064/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790710912 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790710898.885652:0:13214:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1790710898.885658:0:13214:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1790710898.885681:0:13214:0:(import.c:65:import_set_state_nolock()) ffff9c51ff4b0800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1790710898.885911:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790710898.885918:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.146@tcp lock: ffff9c51c8047200/0xcbad34b281570d34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xcbad34b281570d3b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710898.885925:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c8047200 already unused, calling callback (ffffffffc1cdfc20) 10000000:00010000:3.0:1790710898.885928:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.146@tcp lock: ffff9c51c8047200/0xcbad34b281570d34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xcbad34b281570d3b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710898.885936:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.146@tcp lock: ffff9c51c8047200/0xcbad34b281570d34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xcbad34b281570d3b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790710898.885944:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.146@tcp lock: ffff9c51c8047200/0xcbad34b281570d34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xcbad34b281570d3b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790710898.885950:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1790710898.885952:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1790710898.885955:0:5832:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1790710898.885979:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.146@tcp lock: ffff9c51c8047200/0xcbad34b281570d34 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xcbad34b281570d3b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710898.885995:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790710898.886014:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.146@tcp lock: ffff9c51c8047200/0xcbad34b281570d34 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xcbad34b281570d3b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710898.886020:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.146@tcp lock: ffff9c51c8047200/0xcbad34b281570d34 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xcbad34b281570d3b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710898.886031:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790710898.886033:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790710898.886046:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790710898.886060:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c75de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d27fc27-b651-404a-bd8c-b798806fb18a:3310:1877696177064448:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790710898.886606:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710898.886741:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51ff87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1877696177064064:0@lo:400:kworker.0 00000100:00100000:3.0:1790710898.886773:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51ff87ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3308:1877696177064320:0@lo:39:umount.0 00000400:00000100:3.0:1790710898.886797:0:3308:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877696177064320 offset 0 length 224: 4 00000100:00100000:0.0:1790710898.888030:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177064448 00000100:00100000:0.0:1790710898.888039:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177064448 00000100:00100000:0.0:1790710898.888082:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790710898.888089:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c75dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3310:x1877696177064448:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1790710898.888107:0:5830:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790710898 with bad export cookie 14676444701949102621 00000100:00100000:0.0:1790710898.898057:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c75dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3310:x1877696177064448:12345-0@lo:103:ldlm_bl.0 Request processed in 9959us (11444us total) trans 0 rc -107/-107 00000100:00100000:0.0:1790710898.898071:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1790710898.898176:0:3310:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.146@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1790710898.898180:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9c51d02da800 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1790710898.898184:0:3310:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.206.146@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1790710898.902115:0:3310:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.206.146@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1790710898.902120:0:3310:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1790710898.902142:0:3310:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c51c75de300 x1877696177064448/t0(0) o103->MGC192.168.206.146@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790710914 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1790710898.902155:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1790710898.902157:0:3310:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1790710898.902159:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1790710898.902163:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9c51d02da800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790710898.902167:0:3310:0:(import.c:545:import_select_connection()) MGC192.168.206.146@tcp: connect to NID 0@lo last attempt 154 00000100:00080000:3.0:1790710898.902179:0:3310:0:(import.c:666:import_select_connection()) MGC192.168.206.146@tcp: import ffff9c51d02da800 using connection 192.168.206.146@tcp/0@lo 00000100:00100000:3.0:1790710898.902206:0:3310:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c51c75dc700 x1877696177064576/t0(0) o250->MGC192.168.206.146@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790710898.902249:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c75dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5d27fc27-b651-404a-bd8c-b798806fb18a:3308:1877696177064576:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:3.0:1790710898.902289:0:3308:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1877696177064576 offset 0 length 520: 4 00000100:00100000:3.0:1790710898.902336:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c75de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d27fc27-b651-404a-bd8c-b798806fb18a:3310:1877696177064448:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790710899.207327:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1790710899.524458:0:7643:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1790710899.524467:0:7643:0:(genops.c:885:class_export_put()) final put ffff9c51ff486800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1790710899.524622:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c51ff486800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1790710899.531260:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c51f3c08800 for lustre-OST0001 00010000:00010000:3.0:1790710900.231322:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790710901.256766:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790710901.511486:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5d27fc27-b651-404a-bd8c-b798806fb18a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1790710901.511510:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 5d27fc27-b651-404a-bd8c-b798806fb18a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1790710901.511594:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790710901.511614:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51ff87fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1877696177064704:0@lo:400:kworker.0 00000400:00000100:1.0:1790710901.511803:0:3312:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877696177064704 offset 0 length 224: 4 00010000:00010000:2.0:1790710902.279616:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790710903.303326:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790710904.328606:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790710904.519420:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5d27fc27-b651-404a-bd8c-b798806fb18a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790710904.519428:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 5d27fc27-b651-404a-bd8c-b798806fb18a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1790710904.519542:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1877696177064832:0@lo:400:kworker.0 00000400:00000100:1.0:1790710904.519590:0:3312:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877696177064832 offset 0 length 224: 4 00010000:00010000:2.0:1790710905.352664:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790710906.375478:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790710907.402526:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790710908.168161:0:3308:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790710898/real 1790710898] req@ffff9c51c75dc700 x1877696177064576/t0(0) o250->MGC192.168.206.146@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1790710908 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790710908.168191:0:3308:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c51c75dc700 x1877696177064576/t0(0) o250->MGC192.168.206.146@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1790710908 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790710908.168202:0:3308:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790710898/real 1790710898] req@ffff9c51ff87ce00 x1877696177064320/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790710908 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790710908.168213:0:3308:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c51ff87ce00 x1877696177064320/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790710908 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1790710908.168230:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9c51d02da800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790710908.168257:0:3308:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1790710908.168261:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c75dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5d27fc27-b651-404a-bd8c-b798806fb18a:3308:1877696177064576:0@lo:250:ptlrpcd_00_01.0 00000100:00080000:0.0:1790710908.168267:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9c51ff4b0800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1790710908.168285:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51ff87ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3308:1877696177064320:0@lo:39:umount.0 00000100:00080000:3.0:1790710908.168359:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5d27fc27-b651-404a-bd8c-b798806fb18a->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1790710908.168364:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1790710908.168367:0:37:0:(import.c:65:import_set_state_nolock()) ffff9c51d02da800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790710908.168371:0:37:0:(import.c:545:import_select_connection()) MGC192.168.206.146@tcp: connect to NID 0@lo last attempt 376 00000100:00080000:3.0:1790710908.168376:0:37:0:(import.c:630:import_select_connection()) MGC192.168.206.146@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1790710908.168385:0:37:0:(import.c:666:import_select_connection()) MGC192.168.206.146@tcp: import ffff9c51d02da800 using connection 192.168.206.146@tcp/0@lo 00000100:00100000:3.0:1790710908.168414:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c51c75de300 x1877696177064960/t0(0) o250->MGC192.168.206.146@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790710908.168477:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790710908.168489:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c75dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1877696177065088:0@lo:400:kworker.0 00000400:00000100:3.0:1790710908.168533:0:3310:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877696177065088 offset 0 length 224: 4 00000100:00100000:0.0:1790710908.168632:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c75de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5d27fc27-b651-404a-bd8c-b798806fb18a:3308:1877696177064960:0@lo:250:kworker.0 00000400:00000100:0.0:1790710908.168654:0:3308:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1877696177064960 offset 0 length 520: 4 00000100:00080000:1.0:1790710908.170404:0:13214:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790710908.170411:0:13214:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1790710908.170418:0:13214:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1790710908.171324:0:13214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c13fd000/0xcbad34b281570d42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570d49 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710908.171339:0:13214:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c13fd000/0xcbad34b281570d42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbad34b281570d49 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710908.171346:0:13214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c13fd000/0xcbad34b281570d42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xcbad34b281570d49 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710908.171353:0:13214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.146@tcp lock: ffff9c51c13fd000/0xcbad34b281570d42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xcbad34b281570d49 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710908.171376:0:13214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790710908.171384:0:13214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c8046c00/0xcbad34b281570f72 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570f79 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710908.171391:0:13214:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c8046c00/0xcbad34b281570f72 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbad34b281570f79 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710908.171536:0:8509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790710908.171544:0:8509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.146@tcp lock: ffff9c51c13fd000/0xcbad34b281570d42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xcbad34b281570d49 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710908.171551:0:8509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c13fd000 already unused, calling callback (ffffffffc1cdfc20) 10000000:00010000:2.0:1790710908.171554:0:8509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.146@tcp lock: ffff9c51c13fd000/0xcbad34b281570d42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xcbad34b281570d49 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710908.171577:0:8509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.146@tcp lock: ffff9c51c13fd000/0xcbad34b281570d42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xcbad34b281570d49 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790710908.171584:0:8509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.146@tcp lock: ffff9c51c13fd000/0xcbad34b281570d42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xcbad34b281570d49 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790710908.171590:0:8509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1790710908.171592:0:8509:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:2.0:1790710908.171603:0:8509:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c51d02da800 00010000:00010000:2.0:1790710908.171607:0:8509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.146@tcp lock: ffff9c51c13fd000/0xcbad34b281570d42 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xcbad34b281570d49 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710908.171623:0:8509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.146@tcp lock: ffff9c51c13fd000/0xcbad34b281570d42 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xcbad34b281570d49 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710908.171639:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710908.171645:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710908.171647:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790710908.172271:0:13214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c8046c00/0xcbad34b281570f72 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcbad34b281570f79 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710908.172282:0:13214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.146@tcp lock: ffff9c51c8046c00/0xcbad34b281570f72 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcbad34b281570f79 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710908.172349:0:13214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1790710908.172355:0:13214:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:1.0:1790710908.172361:0:13214:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1790710908.172387:0:13214:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1790710908.172392:0:13214:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1790710908.172397:0:13214:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790710908.172403:0:13214:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1790710908.172407:0:13214:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff9c51fa3d19c0) has no exports 00000020:00080000:1.0:1790710908.172434:0:13214:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff9c51fa3d19c0) has no exports 00010000:00010000:3.0:1790710908.174738:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790710908.174752:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.146@tcp lock: ffff9c51c8046c00/0xcbad34b281570f72 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcbad34b281570f79 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710908.174764:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c8046c00 already unused, calling callback (ffffffffc1cdfc20) 10000000:00010000:3.0:1790710908.174768:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.146@tcp lock: ffff9c51c8046c00/0xcbad34b281570f72 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcbad34b281570f79 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710908.174777:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.146@tcp lock: ffff9c51c8046c00/0xcbad34b281570f72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xcbad34b281570f79 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790710908.174896:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.146@tcp lock: ffff9c51c8046c00/0xcbad34b281570f72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xcbad34b281570f79 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790710908.174923:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1790710908.174925:0:5833:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1790710908.174928:0:5833:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1790710908.174956:0:5833:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c51d02da800 00010000:00010000:3.0:1790710908.174961:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.146@tcp lock: ffff9c51c8046c00/0xcbad34b281570f72 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcbad34b281570f79 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710908.174968:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.146@tcp lock: ffff9c51c8046c00/0xcbad34b281570f72 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcbad34b281570f79 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710908.174983:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790710908.174985:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790710908.174987:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1790710908.175251:0:13214:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9c51f42d6480 - data ffff9c51ffd1a6c0/ffff9c51ff9ee400 00000020:01000000:1.0:1790710908.175374:0:13214:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9c51c5c04d20 - data ffff9c51eaed4288/ffff9c51fbaa1800 00100000:10000000:1.0:1790710908.187733:0:13214:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1790710908.215551:0:13214:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcbad34b281570b51 00000020:00000080:2.0:1790710908.215561:0:13214:0:(genops.c:885:class_export_put()) final put ffff9c51f3c0f000/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1790710908.215620:0:13214:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c51f444d000 from lustre-OST0000, refs=2 00000020:01000004:2.0:1790710908.215624:0:13214:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c51f444d000 2 00000020:01000004:2.0:1790710908.215627:0:13214:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c51f444d000 from lustre-OST0000 00000020:00000080:2.0:1790710908.215654:0:13214:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790710908.215664:0:13214:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1790710908.215667:0:13214:0:(genops.c:885:class_export_put()) final put ffff9c51f4bc2000/lustre-OST0000_UUID 00000020:00000080:2.0:1790710908.215670:0:13214:0:(genops.c:844:class_export_destroy()) destroying export ffff9c51f4bc2000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1790710908.215677:0:13214:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1790710908.215720:0:13214:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1790710908.215724:0:13214:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1790710908.215741:0:13214:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790710908.215746:0:13214:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1790710908.215753:0:13214:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9c51ff4b4800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1790710908.215759:0:13214:0:(genops.c:1552:class_disconnect_exports()) OBD device 12 (ffff9c51ff4acd40) has exports, disconnecting them 00000020:00080000:2.0:1790710908.215763:0:13214:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9c51ff4b4800), last request at 1790710695 00000020:00000080:2.0:1790710908.215766:0:13214:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcbad34b281570b7b 00000020:00080000:2.0:1790710908.215775:0:13214:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c51ff4b4800): rc 0 00000020:00000080:2.0:1790710908.215780:0:13214:0:(genops.c:885:class_export_put()) final put ffff9c51ff4b4800/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1790710908.223798:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c51f3c0f000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1790710908.224966:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c51ff4b4800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1790710908.225321:0:13214:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1790710908.225327:0:13214:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790710908.225331:0:13214:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1790710908.225338:0:13214:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1790710908.225501:0:13214:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790710908.225511:0:13214:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:3.0:1790710908.225518:0:13214:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c51f444d000 1 00000020:00000080:3.0:1790710908.225524:0:13214:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcbad34b281570b0b 00000020:00000080:3.0:1790710908.225531:0:13214:0:(genops.c:885:class_export_put()) final put ffff9c51f444c000/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1790710908.225536:0:13214:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1790710908.225540:0:13214:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790710908.225544:0:13214:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1790710908.225548:0:13214:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff9c51fa0e0000) has no exports 00000020:00000080:0.0:1790710908.225811:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c51ff4b0800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1790710908.225820:0:37:0:(genops.c:885:class_export_put()) final put ffff9c51f9478800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1790710908.225836:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c51f9478800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1790710908.225843:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1790710908.225903:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c51f444c000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1790710908.253037:0:13214:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790710908.253051:0:13214:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1790710908.253056:0:13214:0:(genops.c:885:class_export_put()) final put ffff9c51f444f800/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1790710908.253061:0:13214:0:(genops.c:844:class_export_destroy()) destroying export ffff9c51f444f800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1790710908.253067:0:13214:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1790710908.253252:0:13214:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9c51f444d800 00000020:02000400:0.0:1790710908.253316:0:13214:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1790710908.423862:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710909.448049:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790710910.471387:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1790710910.932098:0:13368:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1790710910.952338:0:13368:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1790710910.952428:0:13368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c8047e00/0xcbad34b281570d18 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570d1f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710910.952441:0:13368:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c8047e00/0xcbad34b281570d18 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbad34b281570d1f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710910.952448:0:13368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c8047e00/0xcbad34b281570d18 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcbad34b281570d1f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710910.952454:0:13368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.146@tcp lock: ffff9c51c8047e00/0xcbad34b281570d18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcbad34b281570d1f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710910.952475:0:13368:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1790710910.952480:0:13368:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1790710910.952518:0:13368:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790710910.952529:0:13368:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c51ff87df80 x1877696177064192/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790710912 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790710910.952553:0:13368:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c51ff87fb80 x1877696177064704/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790710917 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790710910.952580:0:13368:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c51f4d62d80 x1877696177064832/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790710920 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790710910.952589:0:13368:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c51c75dce00 x1877696177065088/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790710924 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790710910.952600:0:13368:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:2.0:1790710910.952750:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51ff87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1877696177064192:0@lo:400:kworker.0 00000100:00080000:1.0:1790710910.952783:0:13368:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00010000:00010000:3.0:1790710910.952873:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790710910.952880:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.146@tcp lock: ffff9c51c8047e00/0xcbad34b281570d18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcbad34b281570d1f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710910.952889:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c8047e00 already unused, calling callback (ffffffffc1cdfc20) 10000000:00010000:3.0:1790710910.952892:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.146@tcp lock: ffff9c51c8047e00/0xcbad34b281570d18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcbad34b281570d1f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710910.952901:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.146@tcp lock: ffff9c51c8047e00/0xcbad34b281570d18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcbad34b281570d1f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790710910.952908:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.146@tcp lock: ffff9c51c8047e00/0xcbad34b281570d18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcbad34b281570d1f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790710910.952914:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1790710910.952940:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1790710910.952943:0:5832:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1790710910.952955:0:5832:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c51d02da800 00010000:00010000:3.0:1790710910.952960:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.146@tcp lock: ffff9c51c8047e00/0xcbad34b281570d18 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcbad34b281570d1f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710910.952968:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.146@tcp lock: ffff9c51c8047e00/0xcbad34b281570d18 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcbad34b281570d1f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710910.952980:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790710910.952981:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790710910.952987:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790710910.953038:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c75dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1877696177065088:0@lo:400:kworker.0 00000100:00100000:0.0:1790710910.953335:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1877696177064832:0@lo:400:kworker.0 00000100:00080000:1.0:1790710910.954957:0:13368:0:(import.c:65:import_set_state_nolock()) ffff9c51c64a0800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1790710910.955051:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51ff87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3308:1877696177065216:0@lo:39:umount.0 00000400:00000100:2.0:1790710910.955101:0:3308:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877696177065216 offset 0 length 224: 4 00000100:00100000:0.0:1790710910.955370:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51ff87fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1877696177064704:0@lo:400:kworker.0 00010000:00010000:2.0:1790710911.496170:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790710912.519559:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790710913.287576:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5d27fc27-b651-404a-bd8c-b798806fb18a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1790710913.287586:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 5d27fc27-b651-404a-bd8c-b798806fb18a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1790710913.543337:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710914.567347:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790710915.591438:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790710916.615345:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710917.640029:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790710918.409389:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5d27fc27-b651-404a-bd8c-b798806fb18a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790710918.409398:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 5d27fc27-b651-404a-bd8c-b798806fb18a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1790710918.664872:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790710919.687604:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790710920.135249:0:3308:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790710910/real 1790710910] req@ffff9c51ff87d500 x1877696177065216/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790710920 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790710920.135279:0:3308:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c51ff87d500 x1877696177065216/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790710920 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790710920.135297:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9c51c64a0800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1790710920.135370:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51ff87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3308:1877696177065216:0@lo:39:umount.0 00000100:00080000:1.0:1790710920.137703:0:13368:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790710920.137712:0:13368:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1790710920.137718:0:13368:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1790710920.140058:0:13368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c13fc200/0xcbad34b281570d26 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570d2d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710920.140076:0:13368:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c13fc200/0xcbad34b281570d26 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbad34b281570d2d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710920.140083:0:13368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c13fc200/0xcbad34b281570d26 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcbad34b281570d2d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710920.140089:0:13368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.146@tcp lock: ffff9c51c13fc200/0xcbad34b281570d26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcbad34b281570d2d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710920.140116:0:13368:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790710920.140122:0:13368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c0030e00/0xcbad34b281570f5d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281570f64 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710920.140160:0:13368:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c0030e00/0xcbad34b281570f5d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbad34b281570f64 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710920.140165:0:13368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c0030e00/0xcbad34b281570f5d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcbad34b281570f64 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710920.140170:0:13368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.146@tcp lock: ffff9c51c0030e00/0xcbad34b281570f5d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcbad34b281570f64 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710920.140191:0:13368:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1790710920.140195:0:13368:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1790710920.140217:0:13368:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1790710920.140221:0:13368:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1790710920.140225:0:13368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790710920.140230:0:13368:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1790710920.140234:0:13368:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff9c51f97ccd40) has no exports 00000020:00080000:1.0:1790710920.140255:0:13368:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff9c51f97ccd40) has no exports 00000020:01000000:1.0:1790710920.141803:0:13368:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9c51f42d6f60 - data ffff9c51ffc4b360/ffff9c51ff9ecc00 00010000:00010000:2.0:1790710920.142051:0:8509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790710920.142060:0:8509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.146@tcp lock: ffff9c51c13fc200/0xcbad34b281570d26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcbad34b281570d2d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710920.142081:0:8509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c13fc200 already unused, calling callback (ffffffffc1cdfc20) 10000000:00010000:2.0:1790710920.142085:0:8509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.146@tcp lock: ffff9c51c13fc200/0xcbad34b281570d26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcbad34b281570d2d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710920.142095:0:8509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.146@tcp lock: ffff9c51c13fc200/0xcbad34b281570d26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xcbad34b281570d2d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790710920.142101:0:8509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.146@tcp lock: ffff9c51c13fc200/0xcbad34b281570d26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xcbad34b281570d2d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790710920.142107:0:8509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1790710920.142109:0:8509:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:2.0:1790710920.142112:0:8509:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:2.0:1790710920.142159:0:8509:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c51d02da800 00010000:00010000:2.0:1790710920.142164:0:8509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.146@tcp lock: ffff9c51c13fc200/0xcbad34b281570d26 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcbad34b281570d2d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710920.142171:0:8509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.146@tcp lock: ffff9c51c13fc200/0xcbad34b281570d26 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcbad34b281570d2d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710920.142182:0:8509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790710920.142186:0:8509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.146@tcp lock: ffff9c51c0030e00/0xcbad34b281570f5d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcbad34b281570f64 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710920.142190:0:8509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c0030e00 already unused, calling callback (ffffffffc1cdfc20) 10000000:00010000:2.0:1790710920.142193:0:8509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.146@tcp lock: ffff9c51c0030e00/0xcbad34b281570f5d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcbad34b281570f64 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710920.142199:0:8509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.146@tcp lock: ffff9c51c0030e00/0xcbad34b281570f5d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xcbad34b281570f64 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790710920.142211:0:8509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.146@tcp lock: ffff9c51c0030e00/0xcbad34b281570f5d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xcbad34b281570f64 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790710920.142217:0:8509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1790710920.142219:0:8509:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1790710920.142221:0:8509:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1790710920.142227:0:8509:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c51d02da800 00010000:00010000:2.0:1790710920.142230:0:8509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.146@tcp lock: ffff9c51c0030e00/0xcbad34b281570f5d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xcbad34b281570f64 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710920.142236:0:8509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.146@tcp lock: ffff9c51c0030e00/0xcbad34b281570f5d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xcbad34b281570f64 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710920.142249:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710920.142251:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710920.142252:0:8509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1790710920.144642:0:13368:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9c51f4c08e40 - data ffff9c51ffc07288/ffff9c51f9c9fc00 00010000:00010000:3.0:1790710920.146046:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1790710920.156454:0:13368:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1790710920.190606:0:13368:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcbad34b281570c1c 00000020:00000080:0.0:1790710920.190615:0:13368:0:(genops.c:885:class_export_put()) final put ffff9c51ff482800/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1790710920.190650:0:13368:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c51ff4b3000 from lustre-OST0001, refs=2 00000020:01000004:0.0:1790710920.190653:0:13368:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c51ff4b3000 2 00000020:01000004:0.0:1790710920.190657:0:13368:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c51ff4b3000 from lustre-OST0001 00000020:00000080:0.0:1790710920.190679:0:13368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790710920.190688:0:13368:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1790710920.190691:0:13368:0:(genops.c:885:class_export_put()) final put ffff9c51ff486000/lustre-OST0001_UUID 00000020:00000080:0.0:1790710920.190694:0:13368:0:(genops.c:844:class_export_destroy()) destroying export ffff9c51ff486000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1790710920.190700:0:13368:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1790710920.191070:0:13368:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 5d27fc27-b651-404a-bd8c-b798806fb18a->MGS 00010000:00010000:0.0:1790710920.191086:0:13368:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.146@tcp lock: ffff9c51c8046400/0xcbad34b281570b2e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcbad34b281570b35 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790710920.191324:0:13368:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.146@tcp lock: ffff9c51c8046400/0xcbad34b281570b2e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcbad34b281570b35 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790710920.191330:0:13368:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1790710920.191333:0:13368:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1790710920.191336:0:13368:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1790710920.191351:0:13368:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c51d02da800 00010000:00010000:0.0:1790710920.191355:0:13368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.146@tcp lock: ffff9c51c8046400/0xcbad34b281570b2e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcbad34b281570b35 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710920.191372:0:13368:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.146@tcp lock: ffff9c51c8046000/0xcbad34b281570d6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcbad34b281570d73 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790710920.191378:0:13368:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.146@tcp lock: ffff9c51c8046000/0xcbad34b281570d6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcbad34b281570d73 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790710920.191383:0:13368:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1790710920.191385:0:13368:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1790710920.191386:0:13368:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1790710920.191395:0:13368:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c51d02da800 00010000:00010000:0.0:1790710920.191398:0:13368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.146@tcp lock: ffff9c51c8046000/0xcbad34b281570d6c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcbad34b281570d73 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1790710920.191413:0:13368:0:(import.c:65:import_set_state_nolock()) ffff9c51d02da800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1790710920.191416:0:13368:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1790710920.191419:0:13368:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1790710920.191420:0:13368:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1790710920.191424:0:13368:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1790710920.191435:0:13368:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c51c75de300 x1877696177064960/t0(0) o250->MGC192.168.206.146@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1790710923 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1790710920.191461:0:13368:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1790710920.191464:0:13368:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 4s for inflight to error out 00000100:00100000:1.0:1790710920.191643:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c75de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5d27fc27-b651-404a-bd8c-b798806fb18a:3308:1877696177064960:0@lo:250:kworker.0 10000000:01000000:0.0:1790710920.191708:0:13368:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1790710920.191716:0:13368:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcbad34b281570a0f 00000020:00000080:0.0:1790710920.191722:0:13368:0:(genops.c:885:class_export_put()) final put ffff9c51d0228000/5d27fc27-b651-404a-bd8c-b798806fb18a 00000020:01000000:0.0:1790710920.191729:0:13368:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.206.146@tcp (flags='') 00000020:00000080:0.0:1790710920.191734:0:13368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790710920.191739:0:13368:0:(obd_config.c:956:class_cleanup()) MGC192.168.206.146@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1790710920.191743:0:13368:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff9c51d02d19c0) has no exports 00000020:00000080:2.0:1790710920.191823:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c51ff482800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1790710920.191835:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c51d0228000/5d27fc27-b651-404a-bd8c-b798806fb18a for MGC192.168.206.146@tcp 10000000:01000000:1.0:1790710920.195349:0:5842:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1790710920.195442:0:13368:0:(obd_class.h:668:obd_cleanup_client_import()) MGC192.168.206.146@tcp: client import never connected 00000100:00080000:2.0:1790710920.195447:0:13368:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1790710920.195451:0:13368:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1790710920.195455:0:13368:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1790710920.195457:0:13368:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1790710920.195546:0:13368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790710920.195554:0:13368:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.206.146@tcp (uuid 5d27fc27-b651-404a-bd8c-b798806fb18a) 00000020:01000000:2.0:1790710920.195562:0:13368:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1790710920.195580:0:13368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790710920.195585:0:13368:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1790710920.195592:0:13368:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9c51c64a4000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1790710920.195610:0:13368:0:(genops.c:1552:class_disconnect_exports()) OBD device 16 (ffff9c51fa0e4d40) has exports, disconnecting them 00000020:00080000:2.0:1790710920.195614:0:13368:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9c51c64a4000), last request at 1790710714 00000020:00000080:2.0:1790710920.195618:0:13368:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcbad34b281570c46 00000020:00080000:2.0:1790710920.195632:0:13368:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c51c64a4000): rc 0 00000020:00000080:2.0:1790710920.195637:0:13368:0:(genops.c:885:class_export_put()) final put ffff9c51c64a4000/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1790710920.195711:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c51d02da800 for MGC192.168.206.146@tcp 00000020:00000080:1.0:1790710920.195717:0:8:0:(genops.c:885:class_export_put()) final put ffff9c51d02dc800/5d27fc27-b651-404a-bd8c-b798806fb18a 00000020:00000080:1.0:1790710920.195720:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c51d02dc800/5d27fc27-b651-404a-bd8c-b798806fb18a for MGC192.168.206.146@tcp 00000020:01000000:1.0:1790710920.195741:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.206.146@tcp (5d27fc27-b651-404a-bd8c-b798806fb18a) 00000020:00000080:1.0:1790710920.198203:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c51c64a4000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1790710920.248147:0:13368:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1790710920.248155:0:13368:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790710920.248160:0:13368:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1790710920.248167:0:13368:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1790710920.248611:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:1.0:1790710920.251635:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c51c64a0800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:2.0:1790710920.262986:0:8509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1790710920.264191:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:0.0:1790710920.264385:0:5827:0:(service.c:3206:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9c51c655c600:5827] 0 exiting: rc = 1 00000100:00100000:2.0:1790710920.264489:0:5828:0:(service.c:3206:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9c51c7bd0c00:5828] 1 exiting: rc = 0 00000100:00100000:0.0:1790710920.264642:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.264888:0:5830:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9c51c393a800:5830] 1 exiting: rc = 0 00000100:00100000:1.0:1790710920.265307:0:5829:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9c51c7bd0400:5829] 0 exiting: rc = 1 00000100:00100000:2.0:1790710920.265333:0:8449:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9c51ee780e00:8449] 3 exiting: rc = 0 00000100:00100000:2.0:1790710920.265401:0:5831:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9c51c393b400:5831] 2 exiting: rc = 0 00000100:00100000:0.0:1790710920.265505:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.265513:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.265519:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.265525:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.265531:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.265537:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.265542:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.265550:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.265556:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.265561:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.265566:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.265571:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.265577:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.265583:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.265588:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.265594:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.265601:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.265609:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.265616:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.265625:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.265631:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.265654:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.265660:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.265665:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.265670:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.265676:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.265681:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.265687:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.265692:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.265697:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.265703:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.265708:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.265713:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.265718:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.265723:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.265728:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.265733:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.265739:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.265744:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.265751:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.265756:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.265762:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.265767:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.265773:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.265779:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.265785:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.265790:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.265796:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.265801:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.265807:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.265812:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.265818:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.265824:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.265829:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.265835:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.265840:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.265853:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.265859:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.265863:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.265868:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.265883:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.265889:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.265903:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.265909:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1790710920.268593:0:13368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790710920.268605:0:13368:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1790710920.268610:0:13368:0:(genops.c:885:class_export_put()) final put ffff9c51c64a0000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1790710920.268614:0:13368:0:(genops.c:844:class_export_destroy()) destroying export ffff9c51c64a0000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1790710920.268620:0:13368:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:1.0:1790710920.268672:0:13368:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c51ff4b3000 1 00000020:00000080:1.0:1790710920.268676:0:13368:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcbad34b281570beb 00000020:00000080:1.0:1790710920.268682:0:13368:0:(genops.c:885:class_export_put()) final put ffff9c51ff70b800/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1790710920.268744:0:13368:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1790710920.268750:0:13368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790710920.268754:0:13368:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1790710920.268758:0:13368:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff9c51ff4ab380) has no exports 00000020:00000080:2.0:1790710920.272256:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c51ff70b800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1790710920.286399:0:13368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790710920.286415:0:13368:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1790710920.286421:0:13368:0:(genops.c:885:class_export_put()) final put ffff9c51ff4b2800/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1790710920.286425:0:13368:0:(genops.c:844:class_export_destroy()) destroying export ffff9c51ff4b2800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1790710920.286433:0:13368:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1790710920.286639:0:13368:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9c51ff4b6800 00000020:01000000:1.0:1790710920.286667:0:13368:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1790710920.286672:0:13368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790710920.286676:0:13368:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1790710920.286680:0:13368:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff9c51fa0e19c0) has no exports 00000020:00000080:1.0:1790710920.286704:0:13368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790710920.286709:0:13368:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1790710920.286712:0:13368:0:(genops.c:885:class_export_put()) final put ffff9c51f4448800/OSS_uuid 00000020:00000080:1.0:1790710920.286715:0:13368:0:(genops.c:844:class_export_destroy()) destroying export ffff9c51f4448800/OSS_uuid for OSS 00000020:01000000:1.0:1790710920.286718:0:13368:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:0.0:1790710920.286903:0:5841:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1790710920.287029:0:6698:0:(service.c:3206:ptlrpc_main()) ll_ost00_002: service thread [ffff9c51ca682800:6698] 2 exiting: rc = 0 00000100:00100000:3.0:1790710920.287702:0:6697:0:(service.c:3206:ptlrpc_main()) ll_ost00_001: service thread [ffff9c51da66bc00:6697] 1 exiting: rc = 0 00000100:00100000:3.0:1790710920.287764:0:6696:0:(service.c:3206:ptlrpc_main()) ll_ost00_000: service thread [ffff9c51da66b800:6696] 0 exiting: rc = 1 00000100:00100000:2.0:1790710920.291655:0:12058:0:(service.c:3206:ptlrpc_main()) ll_ost00_003: service thread [ffff9c51f98dfa00:12058] 3 exiting: rc = 0 00000100:00100000:1.0:1790710920.292240:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.292248:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.292253:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.292270:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.292276:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.292281:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.292286:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.292291:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.292296:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.292301:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.292306:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.292311:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.292317:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.292322:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.292327:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.292332:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.292337:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.292342:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.292346:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.292351:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.292356:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.292361:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.292366:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.292370:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.292375:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.292380:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.292384:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.292388:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.292393:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.292397:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.292402:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.292406:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.292411:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.292415:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.292419:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.292424:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.292431:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.292436:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.292446:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.292451:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.292648:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.292655:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.292660:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.292665:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.292670:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.292675:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.292680:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.292684:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.292689:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.292694:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.292698:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.292702:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.292707:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.292712:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.292717:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.292778:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.292784:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.292789:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.292794:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.292799:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.292804:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.292809:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.292813:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.292818:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710920.294679:0:6700:0:(service.c:3206:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9c51ee7da600:6700] 1 exiting: rc = 0 00000100:00100000:2.0:1790710920.294783:0:6699:0:(service.c:3206:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9c51f447e200:6699] 0 exiting: rc = 1 00000100:00100000:0.0:1790710920.294980:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.294989:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.294994:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.294999:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.295004:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.295010:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.295015:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.295021:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.295026:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.295031:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.295036:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.295114:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.295122:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.295152:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.295158:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.295163:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.295168:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.295173:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.295178:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.295184:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.295188:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.295194:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.295199:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.295205:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.295210:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.295227:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.295231:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.295236:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.295242:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.295247:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.295253:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.295258:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.295263:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.295267:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.295272:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.295277:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.295282:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.295288:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.295293:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.295298:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.295303:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.295308:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.295313:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.295318:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.295324:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.295329:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.295335:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.295340:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.295346:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.295351:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.295356:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.295361:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.295365:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.295370:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.295376:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.295381:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.295386:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.295391:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.295396:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.295401:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.295414:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.295420:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.295425:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.295430:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.296651:0:6703:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9c51c7d4f400:6703] 2 exiting: rc = 0 00000100:00100000:2.0:1790710920.297258:0:6701:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9c51c7a87800:6701] 0 exiting: rc = 1 00000100:00100000:2.0:1790710920.297389:0:6702:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9c51f447ea00:6702] 1 exiting: rc = 0 00000100:00100000:0.0:1790710920.297638:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.297646:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.297651:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.297656:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.297661:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.297666:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.297671:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.297676:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.297683:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.297688:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.297693:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.297698:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.297704:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.297710:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.297715:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.297733:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.297741:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.297746:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.297751:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.297756:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.297762:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.297766:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.297771:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.297777:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.297796:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.297803:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.297810:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.297815:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.297821:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.297826:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.297845:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.297850:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.297856:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.297860:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.297865:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.297871:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.297888:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.297902:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.297908:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.297914:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.297919:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.297924:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.297929:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.297935:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.297940:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.297946:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.297952:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.297957:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.297977:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.297983:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.297989:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.297994:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.298000:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.298005:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.298010:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.298016:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.298021:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.298027:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.298034:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.298040:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.298305:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.298316:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.298321:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.298336:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710920.303650:0:6704:0:(service.c:3206:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9c51f447f400:6704] 0 exiting: rc = 1 00000100:00100000:2.0:1790710920.303742:0:6705:0:(service.c:3206:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9c51f447e600:6705] 1 exiting: rc = 0 00000100:00100000:0.0:1790710920.303901:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.303921:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.303927:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.303933:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.303939:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.303944:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.303950:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.303956:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.303961:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.303966:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.303972:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.303977:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.303983:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.303988:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.303994:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.304000:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.304005:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.304010:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.304015:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.304020:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.304026:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.304032:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.304037:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.304052:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.304058:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.304064:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.304069:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.304075:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.304080:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.304086:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.304092:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.304097:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.304102:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.304107:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.304115:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.304121:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.304165:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.304171:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.304178:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.304183:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.304189:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.304194:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.304200:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.304205:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.304209:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.304215:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.304219:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.304225:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.304229:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.304234:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.304239:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.304244:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.304248:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.304253:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.304258:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.304265:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.304273:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.304278:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.304283:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.304288:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.304292:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.304297:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.304302:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790710920.304307:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790710920.305756:0:6707:0:(service.c:3206:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9c51f465c400:6707] 1 exiting: rc = 0 00000100:00100000:0.0:1790710920.305965:0:6706:0:(service.c:3206:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9c51f9cd6800:6706] 0 exiting: rc = 1 00000100:00100000:1.0:1790710920.306074:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.306091:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.306099:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.306104:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.306110:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.306116:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.306122:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.306154:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.306160:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.306179:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.306197:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.306203:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.306208:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.306214:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.306219:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.306224:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.306230:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.306235:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.306240:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.306245:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.306250:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.306256:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.306277:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.306284:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.306289:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.306295:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.306301:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.306307:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.306312:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.306318:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.306327:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.306333:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.306338:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.306345:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.306367:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.306375:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.306380:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.306386:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.306392:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.306398:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.306405:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.306411:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.306417:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.306424:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.306438:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.306445:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.306805:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.306814:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.306819:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.306826:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.306832:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.306838:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.306844:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.306850:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.306856:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.306862:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.306868:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.306886:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.306907:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.306915:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.306920:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.306925:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.306931:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790710920.306943:0:13368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1790710920.319000:0:13368:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1790710935.067898:0:13985:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg646-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1790710942.805528:0:14446:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1790710942.805532:0:14446:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1790710942.805655:0:14446:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c51f49a9800 00000020:01000004:0.0:1790710942.805668:0:14446:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1790710942.805676:0:14446:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1790710942.805697:0:14446:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9c51fa0e19c0) 00000020:00000080:0.0:1790710942.805707:0:14446:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1790710942.819561:0:14446:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1790710942.821323:0:14446:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:0.0:1790710942.821651:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 217: rc = 0 00100000:10000000:0.0:1790710942.821841:0:14446:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1790710942.821908:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 217: rc = 0 00100000:10000000:0.0:1790710942.822053:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 217: rc = 0 00100000:10000000:0.0:1790710942.822249:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 217: rc = 0 00100000:10000000:0.0:1790710942.822342:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 217: rc = 0 00100000:10000000:0.0:1790710942.822428:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 217: rc = 0 00100000:10000000:0.0:1790710942.822690:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 219: rc = 0 00100000:10000000:0.0:1790710942.823634:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 640: rc = 0 00100000:10000000:0.0:1790710942.823737:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 640: rc = 0 00100000:10000000:0.0:1790710942.824235:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 427: rc = 0 00100000:10000000:0.0:1790710942.824477:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 427: rc = 0 00100000:10000000:0.0:1790710942.824820:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 427: rc = 0 00100000:10000000:0.0:1790710942.825109:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 427: rc = 0 00100000:10000000:0.0:1790710942.825375:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 427: rc = 0 00100000:10000000:0.0:1790710942.825622:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 427: rc = 0 00100000:10000000:0.0:1790710942.825889:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 427: rc = 0 00100000:10000000:0.0:1790710942.826239:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 427: rc = 0 00100000:10000000:0.0:1790710942.826482:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 427: rc = 0 00100000:10000000:0.0:1790710942.826718:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 427: rc = 0 00100000:10000000:0.0:1790710942.826988:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 427: rc = 0 00100000:10000000:0.0:1790710942.827256:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 427: rc = 0 00100000:10000000:0.0:1790710942.827643:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 665: rc = 0 00100000:10000000:0.0:1790710942.828549:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 665: rc = 0 00100000:10000000:0.0:1790710942.829112:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 665: rc = 0 00100000:10000000:0.0:1790710942.829382:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 665: rc = 0 00100000:10000000:0.0:1790710942.829844:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 665: rc = 0 00100000:10000000:0.0:1790710942.830098:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 665: rc = 0 00100000:10000000:0.0:1790710942.830573:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 665: rc = 0 00100000:10000000:0.0:1790710942.832350:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 665: rc = 0 00100000:10000000:0.0:1790710942.832874:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 665: rc = 0 00100000:10000000:0.0:1790710942.833169:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 665: rc = 0 00100000:10000000:0.0:1790710942.833572:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 665: rc = 0 00100000:10000000:0.0:1790710942.833955:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 665: rc = 0 00100000:10000000:0.0:1790710942.834280:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 665: rc = 0 00100000:10000000:0.0:1790710942.834590:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 665: rc = 0 00100000:10000000:0.0:1790710942.834966:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 665: rc = 0 00100000:10000000:0.0:1790710942.835242:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 665: rc = 0 00100000:10000000:0.0:1790710942.835488:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 665: rc = 0 00100000:10000000:0.0:1790710942.835893:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 665: rc = 0 00100000:10000000:1.0:1790710942.836357:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 665: rc = 0 00100000:10000000:1.0:1790710942.836858:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 665: rc = 0 00100000:10000000:1.0:1790710942.837109:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 665: rc = 0 00100000:10000000:1.0:1790710942.837850:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 665: rc = 0 00100000:10000000:1.0:1790710942.838099:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 665: rc = 0 00100000:10000000:1.0:1790710942.838397:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 665: rc = 0 00100000:10000000:1.0:1790710942.839166:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 665: rc = 0 00100000:10000000:1.0:1790710942.840400:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 665: rc = 0 00100000:10000000:1.0:1790710942.840877:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 665: rc = 0 00100000:10000000:1.0:1790710942.841153:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 665: rc = 0 00100000:10000000:1.0:1790710942.841391:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 665: rc = 0 00100000:10000000:1.0:1790710942.841919:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 665: rc = 0 00100000:10000000:1.0:1790710942.842228:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 665: rc = 0 00100000:10000000:1.0:1790710942.842744:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 665: rc = 0 00100000:10000000:1.0:1790710942.843116:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 654: rc = 0 00100000:10000000:1.0:1790710942.843966:0:14446:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:1.0:1790710942.844120:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 641: rc = 0 00100000:10000000:1.0:1790710942.844346:0:14446:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:1.0:1790710942.845011:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 641: rc = 0 00100000:10000000:1.0:1790710942.845262:0:14446:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:1.0:1790710942.845334:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 641: rc = 0 00100000:10000000:1.0:1790710942.846970:0:14446:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:1.0:1790710942.847059:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 644: rc = 0 00100000:10000000:1.0:1790710942.847289:0:14446:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:1.0:1790710942.847363:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 644: rc = 0 00100000:10000000:1.0:1790710942.847544:0:14446:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:1.0:1790710942.847600:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 644: rc = 0 00000020:00000080:1.0:1790710942.847865:0:14446:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1790710942.847872:0:14446:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1790710942.847883:0:14446:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcbad34b281571d02 00000020:01000004:1.0:1790710942.847891:0:14446:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1790710942.847896:0:14446:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1790710942.847901:0:14446:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c51f49a9800 from MGS 00000020:01000004:1.0:1790710942.847904:0:14446:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1790710942.847913:0:14446:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9c51c81bb380) 00000020:00000080:1.0:1790710942.847922:0:14446:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1790710942.847974:0:14446:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c51f49a9800 from MGS, refs=2 00080000:01000000:1.0:1790710942.847979:0:14446:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1790710942.847985:0:14446:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcbad34b281571d10 00000100:00100000:1.0:1790710942.848073:0:14446:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1790710942.848215:0:14446:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1790710942.848221:0:14446:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1790710942.851452:0:14446:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1790710942.851463:0:14446:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1790710942.852476:0:14446:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790710942.852662:0:14446:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1790710942.852667:0:14446:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1790710942.854511:0:14446:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1790710942.854522:0:14446:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1790710942.858788:0:14446:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1790710942.858819:0:14446:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1790710942.860114:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710942.860119:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710942.860121:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790710942.860919:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790710942.860923:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790710942.860925:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710942.864797:0:14446:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1790710942.868601:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1790710942.887041:0:14446:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1790710942.887057:0:14446:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1790710942.887060:0:14446:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1790710942.892227:0:14455:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1790710942.893501:0:14446:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1790710942.893627:0:14446:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1790710942.894366:0:14446:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1790710942.894627:0:14446:0:(service.c:173:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790710942.894789:0:14446:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1790710942.894803:0:14446:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1790710942.899031:0:14446:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1790710942.899044:0:14446:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1790710942.899732:0:14446:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1790710942.899740:0:14446:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1790710942.900969:0:14446:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1790710942.900990:0:14446:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.146@tcp' 00000020:01000004:0.0:1790710942.900992:0:14446:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1790710942.901022:0:14446:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.146@tcp (typ=mgc) 00000020:00000080:0.0:1790710942.901032:0:14446:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.146@tcp (ffff9c51fa0e0000) 00000020:00000080:0.0:1790710942.901051:0:14446:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1790710942.901119:0:14446:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c51c64a2000@MGC192.168.206.146@tcp: add connection 192.168.206.146@tcp at head 00010000:00010000:0.0:1790710942.901421:0:14446:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.146@tcp-0 is initialized 00000040:01000000:0.0:1790710942.901427:0:14446:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.146@tcp ctxt 1 is initialized 00000100:00080000:1.0:1790710942.902689:0:14460:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1790710942.904333:0:14461:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1790710942.904426:0:14446:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.146@tcp (uuid b4743a9b-e5c2-4c44-ad7f-283ce8b38224) 00000020:00000080:1.0:1790710942.904451:0:14446:0:(genops.c:1384:class_connect()) connect: client b4743a9b-e5c2-4c44-ad7f-283ce8b38224, cookie 0xcbad34b281571d1e 00000100:00080000:1.0:1790710942.904462:0:14446:0:(import.c:545:import_select_connection()) MGC192.168.206.146@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790710942.904474:0:14446:0:(import.c:666:import_select_connection()) MGC192.168.206.146@tcp: import ffff9c51c64a2000 using connection 192.168.206.146@tcp/0@lo 00000100:00100000:1.0:1790710942.904510:0:14446:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c51ff87ca80 x1877696177065344/t0(0) o250->MGC192.168.206.146@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790710942.904539:0:14446:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import b4743a9b-e5c2-4c44-ad7f-283ce8b38224->MGS 00000020:01000004:1.0:1790710942.904559:0:14446:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1790710942.904581:0:14446:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1790710942.904594:0:14446:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9c51c81bcd40) 00000020:00000080:1.0:1790710942.904606:0:14446:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1790710942.905401:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51ff87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:3308:1877696177065344:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1790710942.905471:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710942.905537:0:14457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177065344 00000100:00100000:0.0:1790710942.905544:0:14457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177065344 00000100:00100000:0.0:1790710942.905575:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790710942.905582:0:14457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4ec4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3308:x1877696177065344:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1790710942.905606:0:14457:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from b4743a9b-e5c2-4c44-ad7f-283ce8b38224@0@lo t0 exp 0000000000000000 cur 420 last 0 00000020:00000080:0.0:1790710942.905627:0:14457:0:(genops.c:1384:class_connect()) connect: client b4743a9b-e5c2-4c44-ad7f-283ce8b38224, cookie 0xcbad34b281571d2c 00000100:00080000:0.0:1790710942.905775:0:14457:0:(import.c:65:import_set_state_nolock()) ffff9c51c64a6000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790710942.905828:0:14457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4ec4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+5:3308:x1877696177065344:12345-0@lo:250:mount.lustre.0 Request processed in 244us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710942.906866:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790710942.906929:0:3308:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.206.146@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1790710942.906939:0:3308:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.206.146@tcp: connect to target with instance 0 00000100:00080000:0.0:1790710942.906946:0:3308:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.206.146@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1790710942.906950:0:3308:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1790710942.906953:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9c51c64a2000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1790710942.906957:0:3308:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1790710942.906966:0:3308:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1790710942.906971:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51ff87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:3308:1877696177065344:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1790710942.914737:0:14446:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790710942.915274:0:14446:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1790710942.915280:0:14446:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1790710942.916084:0:14446:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1790710942.916093:0:14446:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1790710942.921584:0:14446:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1790710942.921598:0:14446:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1790710942.925239:0:14446:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790710942.925743:0:14446:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1790710942.925750:0:14446:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1790710942.926292:0:14446:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1790710942.926300:0:14446:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1790710942.979917:0:14446:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790710942.980105:0:14446:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1790710942.980111:0:14446:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1790710942.981435:0:14446:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1790710942.981447:0:14446:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1790710942.982943:0:14446:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790710942.983120:0:14446:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1790710942.983168:0:14446:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1790710942.984604:0:14446:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1790710942.984614:0:14446:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1790710942.986317:0:14446:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790710942.987642:0:14446:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1790710942.987652:0:14446:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1790710942.988964:0:14446:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1790710942.988974:0:14446:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1790710942.990280:0:14446:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790710942.990448:0:14446:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1790710942.990453:0:14446:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1790710942.991230:0:14446:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1790710942.991241:0:14446:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1790710943.016471:0:14446:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790710943.016814:0:14446:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1790710943.016822:0:14446:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1790710943.018389:0:14446:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1790710943.018402:0:14446:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1790710943.020102:0:14446:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1790710943.020115:0:14446:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1790710943.021370:0:14446:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1790710943.021399:0:14446:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1790710943.021405:0:14446:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.146@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1790710943.021537:0:14446:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.146@tcp ctxt 0 is initialized 00000020:01000004:0.0:1790710943.021570:0:14446:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.146@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1790710943.021575:0:14446:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1790710943.021576:0:14446:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1790710943.021577:0:14446:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790710943.021579:0:14446:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790710943.021580:0:14446:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790710943.021581:0:14446:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790710943.021583:0:14446:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790710943.021584:0:14446:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1790710943.021586:0:14446:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790710943.021587:0:14446:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1790710943.021590:0:14446:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1790710943.021592:0:14446:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790710943.021593:0:14446:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1790710943.021595:0:14446:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790710943.021596:0:14446:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790710943.021597:0:14446:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790710943.021598:0:14446:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790710943.021724:0:14446:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790710943.021726:0:14446:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1790710943.021727:0:14446:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790710943.021729:0:14446:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1790710943.023939:0:14446:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1790710943.023966:0:14446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c50c35b2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:14446:1877696177065472:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1790710943.024040:0:14446:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710943.024265:0:14446:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c11ca540 going to sleep for 11 seconds 00000100:00100000:1.0:1790710943.024374:0:14459:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177065472 00000100:00100000:1.0:1790710943.024387:0:14459:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177065472 00000100:00100000:1.0:1790710943.024471:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790710943.024481:0:14459:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f3d54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+5:14446:x1877696177065472:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1790710943.024525:0:14459:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1790710943.024529:0:14459:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1790710943.024532:0:14459:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1790710943.025104:0:14480:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1790710943.025506:0:14459:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:2.0:1790710943.030215:0:14481:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1790710943.030223:0:14481:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1790710943.030226:0:14481:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1790710943.030260:0:14481:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:1.0:1790710943.030720:0:14459:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1790710943.030731:0:14459:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1790710943.043179:0:14459:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f3d54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+5:14446:x1877696177065472:12345-0@lo:253:mount.lustre.0 Request processed in 18691us (19130us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710943.043261:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790710943.043394:0:14446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c50c35b2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:14446:1877696177065472:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1790710943.043409:0:14446:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1790710943.043412:0:14446:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790710943.043414:0:14446:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1790710943.043415:0:14446:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790710943.043416:0:14446:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790710943.043430:0:14446:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790710943.043432:0:14446:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790710943.043433:0:14446:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790710943.043435:0:14446:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1790710943.043437:0:14446:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790710943.043438:0:14446:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1790710943.043456:0:14446:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c51f49a9800 from lustre-MDT0000 10000000:01000000:0.0:1790710943.043480:0:14446:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1790710943.043482:0:14446:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1790710943.043487:0:14446:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9c51fa0e0000 10000000:01000000:0.0:1790710943.043491:0:14446:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790710943.043498:0:14446:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9c51fa0e0000 from 1 10000000:01000000:0.0:1790710943.043500:0:14446:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1790710943.043532:0:14446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c243b800/0xcbad34b281571d33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710943.043544:0:14446:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.146@tcp lock: ffff9c51c243b800/0xcbad34b281571d33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710943.043554:0:14446:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.146@tcp lock: ffff9c51c243b800/0xcbad34b281571d33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710943.043574:0:14446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c50c35b2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:14446:1877696177065600:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790710943.043731:0:14446:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710943.043808:0:14446:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c11ca540 going to sleep for 11 seconds 00000100:00100000:2.0:1790710943.043859:0:14458:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177065600 00000100:00100000:2.0:1790710943.043866:0:14458:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177065600 00000100:00100000:2.0:1790710943.043936:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790710943.043953:0:14458:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f3d55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+5:14446:x1877696177065600:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790710943.043966:0:14458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790710943.043979:0:14458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c51f43f9400/0xcbad34b281571d3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbad34b281571d33 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710943.044000:0:14458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c51f43f9400/0xcbad34b281571d3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbad34b281571d33 expref: 6 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710943.044010:0:14458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c51f43f9400/0xcbad34b281571d3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281571d33 expref: 6 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710943.044018:0:14458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51f43f9400, rc 0) 00000100:00100000:2.0:1790710943.044107:0:14458:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f3d55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+6:14446:x1877696177065600:12345-0@lo:101:mount.lustre.0 Request processed in 155us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710943.044113:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790710943.044331:0:14446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c50c35b2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:14446:1877696177065600:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790710943.044346:0:14446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.146@tcp lock: ffff9c51c243b800/0xcbad34b281571d33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281571d3a expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710943.044354:0:14446:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.146@tcp lock: ffff9c51c243b800/0xcbad34b281571d33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbad34b281571d3a expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710943.044411:0:14446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c75dce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:14446:1877696177065728:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790710943.044440:0:14446:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710943.044470:0:14446:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f956d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790710943.044525:0:14459:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177065728 00000100:00100000:1.0:1790710943.044530:0:14459:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177065728 00000100:00100000:1.0:1790710943.044561:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790710943.044567:0:14459:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f3d57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+6:14446:x1877696177065728:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790710943.044793:0:14459:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f3d57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+6:14446:x1877696177065728:12345-0@lo:501:mount.lustre.0 Request processed in 225us (351us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790710943.044800:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790710943.044992:0:14446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c75dce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:14446:1877696177065728:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1790710943.045023:0:14446:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.146@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1790710943.045042:0:14446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c243b800/0xcbad34b281571d33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281571d3a expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710943.045051:0:14446:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.146@tcp lock: ffff9c51c243b800/0xcbad34b281571d33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281571d3a expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790710943.045060:0:14446:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c51f49a9800 10000000:01000000:3.0:1790710943.045064:0:14446:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1790710943.045068:0:14446:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9c51f49a9800 10000000:01000000:3.0:1790710943.045070:0:14446:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1790710943.045073:0:14446:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9c51f49a9800 from 1 10000000:01000000:3.0:1790710943.045076:0:14446:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1790710943.045096:0:14446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c8046c00/0xcbad34b281571d41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710943.045104:0:14446:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.146@tcp lock: ffff9c51c8046c00/0xcbad34b281571d41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710943.045113:0:14446:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.146@tcp lock: ffff9c51c8046c00/0xcbad34b281571d41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710943.045148:0:14446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c75dce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:14446:1877696177065856:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790710943.045185:0:14446:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710943.045209:0:14446:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f956d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790710943.045303:0:14457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177065856 00000100:00100000:0.0:1790710943.045308:0:14457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177065856 00000100:00100000:0.0:1790710943.045329:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790710943.045335:0:14457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f3d54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+6:14446:x1877696177065856:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790710943.045344:0:14457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790710943.045357:0:14457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c51c243b000/0xcbad34b281571d48 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbad34b281571d41 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710943.045384:0:14457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c51c243b000/0xcbad34b281571d48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbad34b281571d41 expref: 7 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710943.045393:0:14457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c51c243b000/0xcbad34b281571d48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281571d41 expref: 7 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710943.045399:0:14457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c243b000, rc 0) 00000100:00100000:0.0:1790710943.045438:0:14457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f3d54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+7:14446:x1877696177065856:12345-0@lo:101:mount.lustre.0 Request processed in 103us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710943.045445:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790710943.045560:0:14446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c75dce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:14446:1877696177065856:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790710943.045573:0:14446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.146@tcp lock: ffff9c51c8046c00/0xcbad34b281571d41 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281571d48 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710943.045581:0:14446:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.146@tcp lock: ffff9c51c8046c00/0xcbad34b281571d41 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbad34b281571d48 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790710943.045594:0:14446:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.146@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1790710943.045618:0:14446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c8046c00/0xcbad34b281571d41 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281571d48 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710943.045627:0:14446:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.146@tcp lock: ffff9c51c8046c00/0xcbad34b281571d41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281571d48 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790710943.045633:0:14446:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1790710943.045637:0:14446:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790710943.045642:0:14446:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9c51f49a9800 10000000:01000000:3.0:1790710943.045645:0:14446:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1790710943.045648:0:14446:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1790710943.045650:0:14446:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1790710943.045664:0:14446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c8047e00/0xcbad34b281571d4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710943.045672:0:14446:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.146@tcp lock: ffff9c51c8047e00/0xcbad34b281571d4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710943.045679:0:14446:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.146@tcp lock: ffff9c51c8047e00/0xcbad34b281571d4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710943.045699:0:14446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c75dce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:14446:1877696177065984:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790710943.045724:0:14446:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710943.045791:0:14446:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f956d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790710943.046033:0:14458:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177065984 00000100:00100000:2.0:1790710943.046038:0:14458:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177065984 00000100:00100000:2.0:1790710943.046103:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790710943.046111:0:14458:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f3d57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+7:14446:x1877696177065984:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790710943.046120:0:14458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790710943.046154:0:14458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c51f43f8000/0xcbad34b281571d56 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbad34b281571d4f expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710943.046170:0:14458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c51f43f8000/0xcbad34b281571d56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbad34b281571d4f expref: 8 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710943.046179:0:14458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c51f43f8000/0xcbad34b281571d56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281571d4f expref: 8 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710943.046207:0:14458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51f43f8000, rc 0) 00000100:00100000:2.0:1790710943.046239:0:14458:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f3d57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+8:14446:x1877696177065984:12345-0@lo:101:mount.lustre.0 Request processed in 129us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710943.046245:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790710943.046311:0:14446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c75dce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:14446:1877696177065984:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790710943.046322:0:14446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.146@tcp lock: ffff9c51c8047e00/0xcbad34b281571d4f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281571d56 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710943.046330:0:14446:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.146@tcp lock: ffff9c51c8047e00/0xcbad34b281571d4f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbad34b281571d56 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710943.046373:0:14446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c75dce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:14446:1877696177066112:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790710943.046398:0:14446:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710943.046731:0:14446:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f956d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790710943.046807:0:14459:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177066112 00000100:00100000:1.0:1790710943.046812:0:14459:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177066112 00000100:00100000:1.0:1790710943.046838:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790710943.046844:0:14459:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f3d55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+8:14446:x1877696177066112:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790710943.047287:0:14459:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f3d55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+9:14446:x1877696177066112:12345-0@lo:501:mount.lustre.0 Request processed in 442us (887us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710943.047296:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790710943.047387:0:14446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c75dce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:14446:1877696177066112:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790710943.047422:0:14446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c75dce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:14446:1877696177066240:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790710943.047459:0:14446:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710943.047486:0:14446:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f956d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790710943.047537:0:14459:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177066240 00000100:00100000:1.0:1790710943.047541:0:14459:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177066240 00000100:00100000:1.0:1790710943.047562:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790710943.047567:0:14459:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f3d55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+9:14446:x1877696177066240:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790710943.047983:0:14459:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f3d55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+9:14446:x1877696177066240:12345-0@lo:503:mount.lustre.0 Request processed in 414us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710943.047997:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790710943.048085:0:14446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c75dce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:14446:1877696177066240:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790710943.048771:0:14482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d62300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:14482:1877696177066368:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790710943.048816:0:14482:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710943.048880:0:14482:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51d03b40c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790710943.048907:0:14459:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177066368 00000100:00100000:1.0:1790710943.048912:0:14459:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177066368 00000100:00100000:1.0:1790710943.048965:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790710943.048972:0:14459:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f3d56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+9:14482:x1877696177066368:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790710943.049381:0:14459:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f3d56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+9:14482:x1877696177066368:12345-0@lo:502:llog_process_th.0 Request processed in 408us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710943.049388:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790710943.049507:0:14482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d62300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:14482:1877696177066368:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790710943.049529:0:14482:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790710943.049540:0:14482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790710943.049542:0:14482:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1790710943.049547:0:14482:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1790710943.049549:0:14482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790710943.049565:0:14482:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9c51f97cb380) 00000020:00000080:3.0:1790710943.049579:0:14482:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1790710943.049583:0:14482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1790710943.049765:0:14482:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:3.0:1790710943.049773:0:14482:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcbad34b281571d64 00000020:00000080:3.0:1790710943.049953:0:14482:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1790710943.049956:0:14482:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790710943.049959:0:14482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790710943.049961:0:14482:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1790710943.049963:0:14482:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790710943.049966:0:14482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790710943.049968:0:14482:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1790710943.049970:0:14482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790710943.049976:0:14482:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9c51f97c8000) 00000020:00000080:3.0:1790710943.049984:0:14482:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1790710943.049987:0:14482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1790710943.049989:0:14482:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1790710943.049992:0:14482:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1790710943.049997:0:14482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1790710943.050032:0:14482:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c51f49a9800 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1790710943.050041:0:14482:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9c51f97c99c0) 00000020:00000080:3.0:1790710943.050046:0:14482:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1790710943.050085:0:14482:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1790710943.050090:0:14482:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcbad34b281571d79 00000020:00000080:3.0:1790710943.050417:0:14482:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1790710943.050425:0:14482:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1790710943.050430:0:14482:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xcbad34b281571d80 00080000:01000000:3.0:1790710943.050435:0:14482:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:3.0:1790710943.050439:0:14482:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcbad34b281571d87 00010000:00010000:1.0:1790710943.122850:0:14482:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:1.0:1790710943.123382:0:14482:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967527 00000001:00080000:1.0:1790710943.123676:0:14482:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1790710943.124801:0:14482:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9c51c81b8000) 00000020:00000080:1.0:1790710943.124819:0:14482:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1790710943.124898:0:14482:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:1.0:1790710943.124906:0:14482:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcbad34b281571d95 00000020:00000080:1.0:1790710943.125779:0:14482:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1790710943.141809:0:14482:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xcbad34b281571d9c 00000020:00000080:2.0:1790710943.142458:0:14482:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1790710943.142470:0:14482:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790710943.142477:0:14482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790710943.142479:0:14482:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1790710943.142482:0:14482:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790710943.142489:0:14482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790710943.142490:0:14482:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1790710943.142494:0:14482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1790710943.142528:0:14482:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1790710943.142546:0:14482:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790710943.142550:0:14482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790710943.142551:0:14482:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1790710943.142554:0:14482:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1790710943.142556:0:14482:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1790710943.142557:0:14482:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790710943.142559:0:14482:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790710943.142560:0:14482:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1790710943.142563:0:14482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790710943.142564:0:14482:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1790710943.142566:0:14482:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1790710943.142569:0:14482:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1790710943.142580:0:14482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790710943.142581:0:14482:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1790710943.142586:0:14482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1790710943.142591:0:14482:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.146@tcp to nid 0x20000c0a8ce92 (192.168.206.146@tcp) 00000020:01000000:2.0:1790710943.142614:0:14482:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1790710943.142617:0:14482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790710943.142631:0:14482:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9c51ff4a8000) 00000020:00000080:2.0:1790710943.142645:0:14482:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1790710943.142650:0:14482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1790710943.142699:0:14482:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1790710943.142704:0:14482:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:2.0:1790710943.142709:0:14482:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcbad34b281571daa 00010000:00080000:2.0:1790710943.142736:0:14482:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c51f444d800@lustre-OST0000-osc-MDT0000: add connection 192.168.206.146@tcp at head 00010000:00010000:2.0:1790710943.142964:0:14482:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:2.0:1790710943.143615:0:14482:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1790710943.143659:0:14482:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1790710943.145957:0:14482:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790710943.146046:0:14482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1790710943.146116:0:14482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1790710943.152580:0:14486:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1790710943.152589:0:14486:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1790710943.153356:0:14482:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1790710943.153367:0:14482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1790710943.153397:0:14482:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1790710943.153422:0:14482:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcbad34b281571db1 00000100:00080000:2.0:1790710943.153433:0:14482:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790710943.153443:0:14482:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c51f444d800 using connection 192.168.206.146@tcp/0@lo 00000100:00100000:2.0:1790710943.153478:0:14482:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c51f4d60700 x1877696177066496/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790710943.153496:0:14482:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1790710943.153607:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1877696177066496:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1790710943.153657:0:3308:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877696177066496 offset 0 length 520: 4 00000020:01000000:2.0:1790710943.153832:0:14482:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790710943.153836:0:14482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790710943.153838:0:14482:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1790710943.153841:0:14482:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1790710943.153843:0:14482:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:2.0:1790710943.153845:0:14482:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790710943.153847:0:14482:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790710943.153848:0:14482:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1790710943.153851:0:14482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790710943.153852:0:14482:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:2.0:1790710943.153855:0:14482:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1790710943.153859:0:14482:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1790710943.153862:0:14482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790710943.153864:0:14482:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1790710943.153867:0:14482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1790710943.153870:0:14482:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.146@tcp to nid 0x20000c0a8ce92 (192.168.206.146@tcp) 00000020:01000000:2.0:1790710943.153889:0:14482:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1790710943.153891:0:14482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790710943.153902:0:14482:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9c51ff4a99c0) 00000020:00000080:2.0:1790710943.153913:0:14482:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1790710943.153917:0:14482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1790710943.153968:0:14482:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1790710943.153973:0:14482:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:2.0:1790710943.153978:0:14482:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcbad34b281571dbf 00010000:00080000:2.0:1790710943.154015:0:14482:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c51d02d9800@lustre-OST0001-osc-MDT0000: add connection 192.168.206.146@tcp at head 00010000:00010000:2.0:1790710943.154281:0:14482:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1790710943.154455:0:14482:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1790710943.154479:0:14482:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1790710943.155060:0:14482:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790710943.155118:0:14482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1790710943.155953:0:14482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1790710943.156594:0:14488:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1790710943.156599:0:14488:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1790710943.157534:0:14482:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1790710943.157545:0:14482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1790710943.157584:0:14482:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1790710943.157673:0:14482:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcbad34b281571dc6 00000100:00080000:2.0:1790710943.157686:0:14482:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790710943.157698:0:14482:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c51d02d9800 using connection 192.168.206.146@tcp/0@lo 00000100:00100000:2.0:1790710943.157746:0:14482:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c51f4d60000 x1877696177066624/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790710943.157812:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1877696177066624:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1790710943.157870:0:3308:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877696177066624 offset 0 length 520: 4 00000100:00080000:2.0:1790710943.157920:0:14482:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1790710943.157980:0:14482:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790710943.157984:0:14482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790710943.157986:0:14482:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1790710943.157989:0:14482:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790710943.157993:0:14482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790710943.157994:0:14482:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1790710943.157997:0:14482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1790710943.157999:0:14482:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1790710943.158001:0:14482:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790710943.158003:0:14482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790710943.158004:0:14482:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:2.0:1790710943.158006:0:14482:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790710943.158008:0:14482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790710943.158009:0:14482:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1790710943.158013:0:14482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1790710943.158040:0:14482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d61c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:14482:1877696177066752:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790710943.158088:0:14482:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710943.158109:0:14482:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c8189240 going to sleep for 11 seconds 00000100:00100000:2.0:1790710943.158174:0:14457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177066752 00000100:00100000:2.0:1790710943.158181:0:14457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177066752 00000100:00100000:2.0:1790710943.158216:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790710943.158224:0:14457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f3d54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+9:14482:x1877696177066752:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790710943.158437:0:14457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f3d54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+9:14482:x1877696177066752:12345-0@lo:502:llog_process_th.0 Request processed in 213us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710943.158450:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790710943.158503:0:14482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d61c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:14482:1877696177066752:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790710943.158527:0:14482:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790710943.158532:0:14482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790710943.158533:0:14482:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1790710943.158537:0:14482:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1790710943.158815:0:14446:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:3.0:1790710943.158834:0:14446:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.146@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1790710943.158846:0:14446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c8047e00/0xcbad34b281571d4f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281571d56 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710943.158868:0:14446:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.146@tcp lock: ffff9c51c8047e00/0xcbad34b281571d4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281571d56 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790710943.158876:0:14446:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c51f49a9800 from 1 10000000:01000000:3.0:1790710943.158878:0:14446:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1790710943.158901:0:14446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c8047200/0xcbad34b281571dcd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710943.158908:0:14446:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.146@tcp lock: ffff9c51c8047200/0xcbad34b281571dcd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710943.158918:0:14446:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.146@tcp lock: ffff9c51c8047200/0xcbad34b281571dcd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710943.158931:0:14446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c75dce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:14446:1877696177066880:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790710943.158959:0:14446:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710943.159009:0:14446:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f956de40 going to sleep for 11 seconds 00000100:00100000:1.0:1790710943.159077:0:14459:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177066880 00000100:00100000:1.0:1790710943.159082:0:14459:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177066880 00000100:00100000:1.0:1790710943.159120:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790710943.159146:0:14459:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f3d54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+9:14446:x1877696177066880:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790710943.159156:0:14459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790710943.159169:0:14459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c51c6480200/0xcbad34b281571dd4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbad34b281571dcd expref: -99 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710943.159194:0:14459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c51c6480200/0xcbad34b281571dd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbad34b281571dcd expref: 10 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710943.159211:0:14459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c51c6480200/0xcbad34b281571dd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281571dcd expref: 10 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710943.159226:0:14459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c6480200, rc 0) 00000100:00100000:1.0:1790710943.159254:0:14459:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f3d54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+10:14446:x1877696177066880:12345-0@lo:101:mount.lustre.0 Request processed in 109us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710943.159260:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790710943.159471:0:14446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c75dce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:14446:1877696177066880:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790710943.159484:0:14446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.146@tcp lock: ffff9c51c8047200/0xcbad34b281571dcd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281571dd4 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710943.159493:0:14446:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.146@tcp lock: ffff9c51c8047200/0xcbad34b281571dcd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbad34b281571dd4 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710943.160361:0:14446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c75dce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:14446:1877696177067008:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1790710943.160414:0:14446:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710943.160483:0:14446:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f956de40 going to sleep for 11 seconds 00000100:00100000:2.0:1790710943.160596:0:14458:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177067008 00000100:00100000:2.0:1790710943.160602:0:14458:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177067008 00000100:00100000:2.0:1790710943.160649:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790710943.160657:0:14458:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f3d56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+10:14446:x1877696177067008:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1790710943.160674:0:14458:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1790710943.160681:0:14458:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1790710943.160770:0:14458:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f3d56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+10:14446:x1877696177067008:12345-0@lo:256:mount.lustre.0 Request processed in 113us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710943.160777:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790710943.160957:0:14446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c75dce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:14446:1877696177067008:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1790710943.161592:0:14446:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.146@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1790710943.161766:0:14446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c8047200/0xcbad34b281571dcd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281571dd4 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710943.161783:0:14446:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.146@tcp lock: ffff9c51c8047200/0xcbad34b281571dcd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281571dd4 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790710943.161791:0:14446:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c51f49a9800 from 1 10000000:01000000:0.0:1790710943.161802:0:14446:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790710943.161839:0:14446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c243ae00/0xcbad34b281571ddb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710943.161848:0:14446:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.146@tcp lock: ffff9c51c243ae00/0xcbad34b281571ddb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710943.161856:0:14446:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.146@tcp lock: ffff9c51c243ae00/0xcbad34b281571ddb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710943.161872:0:14446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c50c35b2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:14446:1877696177067136:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790710943.161911:0:14446:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710943.161992:0:14446:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f50ba180 going to sleep for 11 seconds 00000100:00100000:3.0:1790710943.162328:0:14457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177067136 00000100:00100000:3.0:1790710943.162335:0:14457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177067136 00000100:00100000:3.0:1790710943.162408:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790710943.162417:0:14457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f3d57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+10:14446:x1877696177067136:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790710943.162428:0:14457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790710943.162442:0:14457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c51c8047400/0xcbad34b281571de2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbad34b281571ddb expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710943.162461:0:14457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c51c8047400/0xcbad34b281571de2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbad34b281571ddb expref: 11 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710943.162471:0:14457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c51c8047400/0xcbad34b281571de2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281571ddb expref: 11 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710943.162479:0:14457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c8047400, rc 0) 00000100:00100000:3.0:1790710943.162526:0:14457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f3d57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+11:14446:x1877696177067136:12345-0@lo:101:mount.lustre.0 Request processed in 110us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710943.162533:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790710943.162601:0:14446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c50c35b2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:14446:1877696177067136:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790710943.162623:0:14446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.146@tcp lock: ffff9c51c243ae00/0xcbad34b281571ddb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281571de2 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710943.162632:0:14446:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.146@tcp lock: ffff9c51c243ae00/0xcbad34b281571ddb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbad34b281571de2 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710943.162693:0:14446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d61c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:14446:1877696177067264:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790710943.162736:0:14446:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710943.162924:0:14446:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c81899c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790710943.162964:0:14459:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177067264 00000100:00100000:0.0:1790710943.162969:0:14459:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177067264 00000100:00100000:0.0:1790710943.162999:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790710943.163012:0:14459:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f3d56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+11:14446:x1877696177067264:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790710943.163481:0:14459:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f3d56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+11:14446:x1877696177067264:12345-0@lo:501:mount.lustre.0 Request processed in 474us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710943.163489:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790710943.163628:0:14446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d61c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:14446:1877696177067264:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790710943.163679:0:14446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d61c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:14446:1877696177067392:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790710943.163725:0:14446:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710943.163768:0:14446:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c81899c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790710943.163881:0:14459:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177067392 00000100:00100000:0.0:1790710943.163887:0:14459:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177067392 00000100:00100000:0.0:1790710943.163908:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790710943.163914:0:14459:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f3d57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+11:14446:x1877696177067392:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790710943.164089:0:14459:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f3d57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+11:14446:x1877696177067392:12345-0@lo:503:mount.lustre.0 Request processed in 174us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710943.164097:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790710943.164216:0:14446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d61c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:14446:1877696177067392:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790710943.164652:0:14490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d61c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:14490:1877696177067520:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790710943.164707:0:14490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710943.164745:0:14490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c7a68000 going to sleep for 11 seconds 00000100:00100000:0.0:1790710943.164856:0:14459:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177067520 00000100:00100000:0.0:1790710943.164866:0:14459:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177067520 00000100:00100000:0.0:1790710943.164889:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790710943.164896:0:14459:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f3d55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+11:14490:x1877696177067520:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790710943.165097:0:14459:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f3d55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+11:14490:x1877696177067520:12345-0@lo:502:llog_process_th.0 Request processed in 201us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710943.165104:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790710943.165242:0:14490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d61c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:14490:1877696177067520:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790710943.165265:0:14490:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790710943.165275:0:14490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790710943.165277:0:14490:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1790710943.165283:0:14490:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c51f49a9800 00000020:00000080:2.0:1790710943.165286:0:14490:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790710943.165295:0:14490:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790710943.165298:0:14490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790710943.165299:0:14490:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1790710943.165301:0:14490:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790710943.165303:0:14490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790710943.165304:0:14490:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1790710943.165307:0:14490:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c51f49a9800 00000020:00000080:2.0:1790710943.165309:0:14490:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790710943.165356:0:14490:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790710943.165360:0:14490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790710943.165361:0:14490:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1790710943.165364:0:14490:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790710943.165366:0:14490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790710943.165367:0:14490:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1790710943.165371:0:14490:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c51f49a9800 00000020:00000080:2.0:1790710943.165373:0:14490:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1790710943.165418:0:14490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d61c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:14490:1877696177067648:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790710943.165453:0:14490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710943.165466:0:14490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c7a68000 going to sleep for 11 seconds 00000100:00100000:0.0:1790710943.165521:0:14459:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177067648 00000100:00100000:0.0:1790710943.165526:0:14459:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177067648 00000100:00100000:0.0:1790710943.165545:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790710943.165550:0:14459:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4765450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+11:14490:x1877696177067648:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790710943.165741:0:14459:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4765450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+11:14490:x1877696177067648:12345-0@lo:502:llog_process_th.0 Request processed in 189us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710943.165747:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790710943.168521:0:14490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d61c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:14490:1877696177067648:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790710943.168559:0:14490:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790710943.168566:0:14490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790710943.168569:0:14490:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1790710943.168574:0:14490:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1790710943.171539:0:14446:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1790710943.171571:0:14446:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790710943.171586:0:14446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c243ae00/0xcbad34b281571ddb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281571de2 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710943.171598:0:14446:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.146@tcp lock: ffff9c51c243ae00/0xcbad34b281571ddb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281571de2 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790710943.172749:0:14446:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1790710943.172761:0:14446:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c51f49a9800 10000000:01000000:0.0:1790710943.172764:0:14446:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c51f49a9800 10000000:01000000:0.0:1790710943.172769:0:14446:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790710943.172774:0:14446:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c51f49a9800 from 1 10000000:01000000:0.0:1790710943.172777:0:14446:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790710943.172810:0:14446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c243be00/0xcbad34b281571de9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710943.172825:0:14446:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.146@tcp lock: ffff9c51c243be00/0xcbad34b281571de9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710943.172836:0:14446:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.146@tcp lock: ffff9c51c243be00/0xcbad34b281571de9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710943.172858:0:14446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c50c35b1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:14446:1877696177067776:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790710943.172924:0:14446:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710943.172965:0:14446:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c71280c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790710943.172990:0:14459:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177067776 00000100:00100000:0.0:1790710943.172997:0:14459:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177067776 00000100:00100000:0.0:1790710943.173035:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790710943.173044:0:14459:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4764c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+11:14446:x1877696177067776:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790710943.173057:0:14459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790710943.173069:0:14459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c51c243b400/0xcbad34b281571df0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbad34b281571de9 expref: -99 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710943.173091:0:14459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c51c243b400/0xcbad34b281571df0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbad34b281571de9 expref: 12 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710943.173102:0:14459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c51c243b400/0xcbad34b281571df0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281571de9 expref: 12 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710943.173109:0:14459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c243b400, rc 0) 00000100:00100000:0.0:1790710943.173162:0:14459:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4764c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+12:14446:x1877696177067776:12345-0@lo:101:mount.lustre.0 Request processed in 119us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710943.173169:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790710943.173220:0:14446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c50c35b1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:14446:1877696177067776:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790710943.173234:0:14446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.146@tcp lock: ffff9c51c243be00/0xcbad34b281571de9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281571df0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710943.173242:0:14446:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.146@tcp lock: ffff9c51c243be00/0xcbad34b281571de9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbad34b281571df0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710943.173285:0:14446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c50c35b1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:14446:1877696177067904:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790710943.173308:0:14446:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710943.173322:0:14446:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c71280c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790710943.173333:0:14459:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177067904 00000100:00100000:0.0:1790710943.173337:0:14459:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177067904 00000100:00100000:0.0:1790710943.173354:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790710943.173358:0:14459:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4764050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+12:14446:x1877696177067904:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790710943.173601:0:14459:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4764050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+12:14446:x1877696177067904:12345-0@lo:501:mount.lustre.0 Request processed in 241us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710943.175887:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790710943.175956:0:14446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c50c35b1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:14446:1877696177067904:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790710943.176010:0:14446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c50c35b1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:14446:1877696177068032:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790710943.176066:0:14446:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710943.177349:0:14446:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c8d98b40 going to sleep for 11 seconds 00000100:00100000:3.0:1790710943.179188:0:14458:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177068032 00000100:00100000:3.0:1790710943.179202:0:14458:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177068032 00000100:00100000:3.0:1790710943.179258:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790710943.179269:0:14458:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4765c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+12:14446:x1877696177068032:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790710943.179508:0:14458:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4765c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+12:14446:x1877696177068032:12345-0@lo:503:mount.lustre.0 Request processed in 241us (3441us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710943.179516:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790710943.179543:0:14446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c50c35b1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:14446:1877696177068032:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790710943.184312:0:14495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c75dd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:14495:1877696177068160:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790710943.184390:0:14495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710943.184465:0:14495:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f956de40 going to sleep for 11 seconds 00000100:00100000:0.0:1790710943.184595:0:14459:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177068160 00000100:00100000:0.0:1790710943.184665:0:14459:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177068160 00000100:00100000:0.0:1790710943.184751:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790710943.184770:0:14459:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4767850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+12:14495:x1877696177068160:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790710943.185015:0:14459:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4767850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+12:14495:x1877696177068160:12345-0@lo:502:llog_process_th.0 Request processed in 245us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710943.185024:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790710943.185102:0:14495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c75dd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:14495:1877696177068160:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1790710943.185180:0:14495:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1790710943.185193:0:14495:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9c51ff4ab380) 00000020:00000080:2.0:1790710943.185210:0:14495:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:2.0:1790710943.185278:0:14495:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c51f49a9800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1790710943.185282:0:14495:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c51f49a9800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1790710943.185284:0:14495:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c51f49a9800 4 00010000:00080000:2.0:1790710943.185311:0:14495:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c51fa3c8800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.146@tcp at head 00010000:00010000:2.0:1790710943.186919:0:14495:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1790710943.187099:0:14495:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1790710943.187157:0:14495:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1790710943.187169:0:14495:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xcbad34b281571dfe 00000100:00080000:2.0:1790710943.187178:0:14495:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790710943.187188:0:14495:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9c51fa3c8800 using connection 192.168.206.146@tcp/0@lo 00000100:00100000:2.0:1790710943.187220:0:14495:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c51f4d61c00 x1877696177068288/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790710943.187241:0:14495:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1790710943.188797:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877696177068288:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1790710943.188876:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710943.191222:0:14464:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177068288 00000100:00100000:3.0:1790710943.191233:0:14464:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177068288 00000100:00100000:3.0:1790710943.191273:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790710943.191280:0:14464:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3308:x1877696177068288:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1790710943.191367:0:14464:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3308:x1877696177068288:12345-0@lo:38:llog_process_th.0 Request processed in 85us (2490us total) trans 0 rc -11/-11 00000100:00100000:3.0:1790710943.191374:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790710943.191414:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790710943.191423:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9c51fa3c8800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790710943.191427:0:3308:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1790710943.191431:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877696177068288:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1790710943.192063:0:14495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51ff87f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:14495:1877696177068416:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790710943.192313:0:14495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710943.192343:0:14495:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51ff5db540 going to sleep for 11 seconds 00000100:00100000:3.0:1790710943.193721:0:14457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177068416 00000100:00100000:3.0:1790710943.193731:0:14457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177068416 00000100:00100000:3.0:1790710943.193805:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790710943.193815:0:14457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4765050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+12:14495:x1877696177068416:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790710943.194070:0:14457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4765050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+12:14495:x1877696177068416:12345-0@lo:502:llog_process_th.0 Request processed in 256us (1756us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710943.194078:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790710943.200902:0:14495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51ff87f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:14495:1877696177068416:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1790710943.200943:0:14495:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1790710943.201259:0:14446:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1790710943.201285:0:14446:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790710943.201305:0:14446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c243be00/0xcbad34b281571de9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281571df0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710943.201316:0:14446:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.146@tcp lock: ffff9c51c243be00/0xcbad34b281571de9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281571df0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1790710943.201364:0:14446:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1790710943.201366:0:14446:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1790710943.201368:0:14446:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790710943.201369:0:14446:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790710943.201370:0:14446:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790710943.201372:0:14446:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790710943.201373:0:14446:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790710943.201374:0:14446:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1790710943.201376:0:14446:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790710943.201377:0:14446:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790710943.201380:0:14446:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1790710943.201383:0:14446:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790710943.201384:0:14446:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1790710943.201385:0:14446:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790710943.201386:0:14446:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790710943.201387:0:14446:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790710943.201388:0:14446:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790710943.201389:0:14446:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790710943.201390:0:14446:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1790710943.201392:0:14446:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790710943.201393:0:14446:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790710943.201416:0:14446:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1790710943.201432:0:14446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c50c35b1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:14446:1877696177068544:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1790710943.201516:0:14446:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710943.201554:0:14446:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c7ed0780 going to sleep for 11 seconds 00000100:00100000:0.0:1790710943.201576:0:14459:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177068544 00000100:00100000:0.0:1790710943.201582:0:14459:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177068544 00000100:00100000:0.0:1790710943.201637:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790710943.201645:0:14459:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4765850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+12:14446:x1877696177068544:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1790710943.201669:0:14459:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1790710943.201683:0:14459:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1790710943.234605:0:14459:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1790710943.234624:0:14459:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1790710943.235029:0:14480:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1790710943.235034:0:14480:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1790710943.235055:0:14480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c51f43f9e00/0xcbad34b281571e05 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710943.235072:0:14480:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c51c6480200/0xcbad34b281571dd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281571dcd expref: 12 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710943.235081:0:14480:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c51f43f9e00/0xcbad34b281571e05 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710943.235119:0:14480:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c51c6480200/0xcbad34b281571dd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbad34b281571dcd expref: 12 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710943.235170:0:14480:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c51c6480200/0xcbad34b281571dd4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbad34b281571dcd expref: 12 pid: 14459 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710943.235185:0:14480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d60a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14480:1877696177068672:0@lo:104: 00000100:00100000:2.0:1790710943.235245:0:14480:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710943.235346:0:14480:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c1254a80 going to sleep for 11 seconds 00000100:00100000:1.0:1790710943.235433:0:14447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177068672 00000100:00100000:1.0:1790710943.235442:0:14447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177068672 00000100:00100000:1.0:1790710943.235489:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790710943.235499:0:14447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d62d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+3:14480:x1877696177068672:12345-0@lo:104: 00010000:00010000:1.0:1790710943.235513:0:14447:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.146@tcp lock: ffff9c51c8047200/0xcbad34b281571dcd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbad34b281571dd4 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710943.235575:0:14447:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790710943.235583:0:14447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d62d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+3:14480:x1877696177068672:12345-0@lo:104: Request processed in 85us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710943.235590:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1790710943.235610:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1790710943.235614:0:14480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d60a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14480:1877696177068672:0@lo:104: 00010000:00010000:1.0:1790710943.235616:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.146@tcp lock: ffff9c51c8047200/0xcbad34b281571dcd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbad34b281571dd4 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710943.235633:0:14480:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c51f43f9e00/0xcbad34b281571e05 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710943.235640:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c8047200 already unused, calling callback (ffffffffc1cdfc20) 10000000:00010000:1.0:1790710943.235644:0:14453:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.146@tcp lock: ffff9c51c8047200/0xcbad34b281571dcd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbad34b281571dd4 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710943.235653:0:14453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.146@tcp lock: ffff9c51c8047200/0xcbad34b281571dcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbad34b281571dd4 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790710943.235660:0:14453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.146@tcp lock: ffff9c51c8047200/0xcbad34b281571dcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbad34b281571dd4 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790710943.235666:0:14453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1790710943.235698:0:14453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.146@tcp lock: ffff9c51c8047200/0xcbad34b281571dcd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281571dd4 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710943.235706:0:14453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790710943.235724:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.146@tcp lock: ffff9c51c8047200/0xcbad34b281571dcd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281571dd4 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710943.235730:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.146@tcp lock: ffff9c51c8047200/0xcbad34b281571dcd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281571dd4 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710943.235746:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790710943.235748:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790710943.235750:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790710943.235782:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51ff87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:3310:1877696177068800:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790710943.235811:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710943.235895:0:14449:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177068800 00000100:00100000:0.0:1790710943.235900:0:14449:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177068800 00010000:00010000:0.0:1790710943.235919:0:14449:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c51c6480200/0xcbad34b281571dd4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbad34b281571dcd expref: 13 pid: 14459 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710943.235946:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790710943.235954:0:14449:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff87d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+13:3310:x1877696177068800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790710943.235964:0:14449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790710943.235969:0:14449:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c51c6480200/0xcbad34b281571dd4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbad34b281571dcd expref: 13 pid: 14459 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710943.235979:0:14449:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c51c6480200/0xcbad34b281571dd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbad34b281571dcd expref: 13 pid: 14459 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710943.235992:0:14449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c51c6480200/0xcbad34b281571dd4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbad34b281571dcd expref: 13 pid: 14459 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710943.236015:0:14449:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c51f43f9e00/0xcbad34b281571e05 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710943.236023:0:14449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c51f43f9e00/0xcbad34b281571e05 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1790710943.236035:0:14449:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001001258s 00010000:00010000:0.0:1790710943.236039:0:14449:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c51f43f9e00/0xcbad34b281571e05 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710943.236046:0:14449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c51f43f9e00/0xcbad34b281571e05 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710943.236053:0:14449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c51f43f9e00/0xcbad34b281571e05 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710943.236060:0:14449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c51f43f9e00/0xcbad34b281571e05 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710943.236065:0:14449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51f43f9e00 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:0.0:1790710943.236070:0:14449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c51f43f9e00/0xcbad34b281571e05 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710943.236076:0:14449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c51f43f9e00/0xcbad34b281571e05 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710943.236105:0:14449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c51f43f9e00/0xcbad34b281571e05 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710943.236114:0:14449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790710943.236184:0:14449:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff87d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+12:3310:x1877696177068800:12345-0@lo:103:ldlm_bl.0 Request processed in 231us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710943.236190:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1790710943.236387:0:14480:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c51f43f9e00/0xcbad34b281571e05 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710943.236396:0:14480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c51f43f9e00/0xcbad34b281571e05 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710943.236402:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c51f43f9e00/0xcbad34b281571e05 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710943.236444:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51ff87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:3310:1877696177068800:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790710943.254317:0:14459:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4765850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+11:14446:x1877696177068544:12345-0@lo:253:mount.lustre.0 Request processed in 52661us (52789us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710943.254331:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790710943.254436:0:14446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c50c35b1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:14446:1877696177068544:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1790710943.254453:0:14446:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1790710943.254457:0:14446:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790710943.254459:0:14446:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1790710943.254460:0:14446:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790710943.254461:0:14446:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790710943.254463:0:14446:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790710943.254464:0:14446:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790710943.254465:0:14446:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790710943.254467:0:14446:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1790710943.254469:0:14446:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790710943.254470:0:14446:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1790710943.254486:0:14446:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1790710943.259271:0:14446:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1790710943.259433:0:14446:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1790710943.259710:0:14446:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1790710943.259876:0:14446:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1790710943.260181:0:14446:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1790710943.260341:0:14446:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1790710943.262431:0:14446:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1790710943.262602:0:14446:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1790710943.262891:0:14446:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1790710943.263111:0:14446:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1790710943.263417:0:14446:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1790710943.263558:0:14446:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:3.0:1790710943.312519:0:14446:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1790710943.312918:0:14446:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1790710943.313245:0:14503:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:1.0:1790710943.313316:0:14503:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:3.0:1790710943.316259:0:14446:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1790710943.316380:0:14446:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:2.0:1790710943.317705:0:14502:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:2.0:1790710943.317711:0:14502:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000004:00000080:3.0:1790710943.318154:0:14446:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1790710943.318167:0:14446:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1790710943.318396:0:14446:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790710943.318739:0:14503:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1790710943.319026:0:14503:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1790710943.319031:0:14503:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:3.0:1790710943.320579:0:14446:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1790710943.321406:0:14446:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1790710943.321451:0:14446:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1790710943.322004:0:14446:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:3.0:1790710943.324017:0:14446:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:3.0:1790710943.330101:0:14446:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1790710943.364420:0:14446:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1790710943.364459:0:14446:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb1c781cc7988 00100000:10000000:2.0:1790710943.364468:0:14446:0:(lfsck_lib.c:3084:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1790710943.365502:0:14446:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1790710943.365519:0:14446:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.146@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1790710943.365533:0:14446:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1790710943.365547:0:14446:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:2.0:1790710943.879267:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790710944.201806:0:14496:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790710944.201815:0:14496:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790710944.202168:0:14496:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:0.0:1790710944.202176:0:14496:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 10000000:01000000:0.0:1790710944.904033:0:14461:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1790710944.904040:0:14461:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c51f49a9800 from 6 10000000:01000000:0.0:1790710944.904045:0:14461:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790710944.904081:0:14461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c243a200/0xcbad34b281571e0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710944.904092:0:14461:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.146@tcp lock: ffff9c51c243a200/0xcbad34b281571e0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710944.904104:0:14461:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.146@tcp lock: ffff9c51c243a200/0xcbad34b281571e0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710944.904320:0:14461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c50c35b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:14461:1877696177068928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790710944.904398:0:14461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710944.904448:0:14461:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f9b2db40 going to sleep for 11 seconds 00000100:00100000:3.0:1790710944.904755:0:14458:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177068928 00000100:00100000:3.0:1790710944.904763:0:14458:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177068928 00000100:00100000:3.0:1790710944.904818:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1790710944.904827:0:14458:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4766850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+11:14461:x1877696177068928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790710944.904841:0:14458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790710944.904856:0:14458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c51c8046200/0xcbad34b281571e13 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbad34b281571e0c expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710944.904878:0:14458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c51c8046200/0xcbad34b281571e13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbad34b281571e0c expref: 12 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710944.904889:0:14458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c51c8046200/0xcbad34b281571e13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281571e0c expref: 12 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710944.904899:0:14458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c8046200, rc 0) 00000100:00100000:3.0:1790710944.904971:0:14458:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4766850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+12:14461:x1877696177068928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710944.904978:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1790710944.905026:0:14461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c50c35b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:14461:1877696177068928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790710944.905041:0:14461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.146@tcp lock: ffff9c51c243a200/0xcbad34b281571e0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281571e13 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710944.905050:0:14461:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.146@tcp lock: ffff9c51c243a200/0xcbad34b281571e0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbad34b281571e13 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710944.905105:0:14461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c75df100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:14461:1877696177069056:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1790710944.905180:0:14461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710944.905207:0:14461:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51ccbd4540 going to sleep for 11 seconds 00000100:00100000:0.0:1790710944.905484:0:14457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177069056 00000100:00100000:0.0:1790710944.905489:0:14457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177069056 00000100:00100000:0.0:1790710944.905524:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790710944.905531:0:14457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c529fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+12:14461:x1877696177069056:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1790710944.905545:0:14457:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1790710944.905561:0:14457:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1790710944.905564:0:14457:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1790710944.905640:0:14457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c529fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+12:14461:x1877696177069056:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 109us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710944.905648:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1790710944.905730:0:14461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c75df100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:14461:1877696177069056:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1790710944.905782:0:14461:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.146@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790710944.905790:0:14461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c243a200/0xcbad34b281571e0c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281571e13 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710944.905799:0:14461:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.146@tcp lock: ffff9c51c243a200/0xcbad34b281571e0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281571e13 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710944.907076:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790710945.223335:0:14496:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790710945.223355:0:14496:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790710945.223833:0:14496:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1790710945.223895:0:14496:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790710945.223924:0:14496:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00010000:00010000:0.0:1790710945.928478:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790710946.951508:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1790710947.045478:0:14745:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg646-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1790710947.975762:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790710948.615238:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790710948.615244:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790710948.615247:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790710948.615260:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790710948.615262:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1790710948.615265:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1790710948.615269:0:37:0:(import.c:65:import_set_state_nolock()) ffff9c51fa3c8800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790710948.615284:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9c51fa3c8800 using connection 192.168.206.146@tcp/0@lo 00000100:00100000:0.0:1790710948.615305:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c50c35b3b80 x1877696177069312/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790710948.615569:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c50c35b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:3311:1877696177069184:0@lo:400:kworker.0 00000100:00100000:3.0:1790710948.615636:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710948.615760:0:14457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177069184 00000100:00100000:1.0:1790710948.615769:0:14457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177069184 00000100:00100000:1.0:1790710948.615876:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790710948.615885:0:14457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c529f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+12:3311:x1877696177069184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790710948.615921:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c50c35b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877696177069312:0@lo:38:kworker.0 00000100:00100000:1.0:1790710948.615936:0:14457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c529f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+12:3311:x1877696177069184:12345-0@lo:400:kworker.0 Request processed in 53us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710948.615943:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790710948.615947:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710948.615983:0:14466:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177069312 00000100:00100000:1.0:1790710948.615987:0:14466:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177069312 00000100:00100000:1.0:1790710948.616009:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790710948.616014:0:14466:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c75df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3308:x1877696177069312:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1790710948.616034:0:14466:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 425 last 0 00000100:00100000:0.0:1790710948.616050:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c50c35b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:3311:1877696177069184:0@lo:400:kworker.0 00000020:00000080:1.0:1790710948.616075:0:14466:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xcbad34b281571e1a 00000004:00100000:1.0:1790710948.616087:0:14466:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1790710948.616221:0:14466:0:(import.c:65:import_set_state_nolock()) ffff9c51ee530800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790710948.616260:0:14466:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c75df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1877696177069312:12345-0@lo:38:kworker.0 Request processed in 244us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710948.616266:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1790710948.616293:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c50c35b3b80 x1877696177069312/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790710958 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1790710948.616305:0:3308:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1790710948.616311:0:3308:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1790710948.616315:0:3308:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1790710948.616317:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9c51fa3c8800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1790710948.616323:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c50c35b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877696177069312:0@lo:38:kworker.0 00010000:00010000:0.0:1790710949.000556:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1790710949.687100:0:14897:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff21a62390 20000000:00000080:3.0:1790710949.687183:0:14897:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c51fa6d6800 uarg=0000000000000000 20000000:01000000:3.0:1790710949.687237:0:14897:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1790710949.687246:0:14897:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1790710949.687251:0:14897:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1790710949.688522:0:14898:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:3.0:1790710949.688693:0:14897:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1790710949.694857:0:14897:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1790710949.694886:0:14897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c51c8046800/0xcbad34b281571e21 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710949.694903:0:14897:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c51c8047400/0xcbad34b281571de2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281571ddb expref: 11 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710949.694912:0:14897:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c51c8046800/0xcbad34b281571e21 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710949.694952:0:14897:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c51c8047400/0xcbad34b281571de2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbad34b281571ddb expref: 11 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710949.694968:0:14897:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c51c8047400/0xcbad34b281571de2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbad34b281571ddb expref: 11 pid: 14457 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710949.694983:0:14897:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c75dd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14897:1877696177069440:0@lo:104: 00000100:00100000:3.0:1790710949.695045:0:14897:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710949.695190:0:14897:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c78e1840 going to sleep for 11 seconds 00000100:00100000:0.0:1790710949.699578:0:14448:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177069440 00000100:00100000:0.0:1790710949.699594:0:14448:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177069440 00000100:00100000:0.0:1790710949.699661:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790710949.699670:0:14448:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c75ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+3:14897:x1877696177069440:12345-0@lo:104: 00010000:00010000:0.0:1790710949.699688:0:14448:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.146@tcp lock: ffff9c51c243ae00/0xcbad34b281571ddb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbad34b281571de2 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710949.699804:0:14448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790710949.699811:0:14448:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c75ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+3:14897:x1877696177069440:12345-0@lo:104: Request processed in 143us (4766us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710949.699818:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1790710949.699839:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790710949.699845:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.146@tcp lock: ffff9c51c243ae00/0xcbad34b281571ddb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbad34b281571de2 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710949.699853:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c243ae00 already unused, calling callback (ffffffffc1cdfc20) 10000000:00010000:0.0:1790710949.699857:0:14452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.146@tcp lock: ffff9c51c243ae00/0xcbad34b281571ddb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbad34b281571de2 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710949.699878:0:14452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.146@tcp lock: ffff9c51c243ae00/0xcbad34b281571ddb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbad34b281571de2 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790710949.699885:0:14452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.146@tcp lock: ffff9c51c243ae00/0xcbad34b281571ddb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbad34b281571de2 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790710949.699890:0:14452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790710949.699924:0:14452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.146@tcp lock: ffff9c51c243ae00/0xcbad34b281571ddb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281571de2 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710949.699931:0:14452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790710949.699952:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.146@tcp lock: ffff9c51c243ae00/0xcbad34b281571ddb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281571de2 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710949.699958:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.146@tcp lock: ffff9c51c243ae00/0xcbad34b281571ddb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281571de2 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710949.699975:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790710949.699977:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790710949.699979:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790710949.699998:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c50c35b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:3312:1877696177069568:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790710949.700035:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710949.700089:0:14450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177069568 00000100:00100000:0.0:1790710949.700093:0:14450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177069568 00010000:00010000:0.0:1790710949.700111:0:14450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c51c8047400/0xcbad34b281571de2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbad34b281571ddb expref: 12 pid: 14457 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710949.700158:0:14450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790710949.700164:0:14450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c50c35b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+12:3312:x1877696177069568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790710949.700181:0:14450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790710949.700186:0:14450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c51c8047400/0xcbad34b281571de2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbad34b281571ddb expref: 12 pid: 14457 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710949.700197:0:14450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c51c8047400/0xcbad34b281571de2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbad34b281571ddb expref: 12 pid: 14457 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710949.700216:0:14450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c51c8046800/0xcbad34b281571e21 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710949.700223:0:14450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c51c8046800/0xcbad34b281571e21 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710949.700236:0:14450:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c51c8046800/0xcbad34b281571e21 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710949.700243:0:14450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c51c8046800/0xcbad34b281571e21 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710949.700250:0:14450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c51c8046800/0xcbad34b281571e21 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710949.700255:0:14450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c51c8046800/0xcbad34b281571e21 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710949.700260:0:14450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c8046800 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:0.0:1790710949.700264:0:14450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c51c8046800/0xcbad34b281571e21 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710949.700271:0:14450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c51c8046800/0xcbad34b281571e21 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710949.700290:0:14450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c51c8046800/0xcbad34b281571e21 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710949.700299:0:14450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790710949.700497:0:14897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c51c8047400/0xcbad34b281571de2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbad34b281571ddb expref: 12 pid: 14457 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710949.700508:0:14897:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c75dd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14897:1877696177069440:0@lo:104: 00010000:00010000:1.0:1790710949.700525:0:14897:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c51c8046800/0xcbad34b281571e21 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710949.700534:0:14897:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c51c8046800/0xcbad34b281571e21 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710949.700540:0:14897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c51c8046800/0xcbad34b281571e21 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710949.700546:0:14897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c51c8046800/0xcbad34b281571e21 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710949.702528:0:14450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c50c35b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+11:3312:x1877696177069568:12345-0@lo:103:ldlm_bl.0 Request processed in 2356us (2484us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710949.702540:0:14450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790710949.702834:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c50c35b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:3312:1877696177069568:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790710950.024994:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790710951.049429:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1790710951.432215:0:14461:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790710951.432223:0:14461:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c51f49a9800 from 10 10000000:01000000:0.0:1790710951.432228:0:14461:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790710951.432276:0:14461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c243a400/0xcbad34b281571e28 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710951.432288:0:14461:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.146@tcp lock: ffff9c51c243a400/0xcbad34b281571e28 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710951.432299:0:14461:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.146@tcp lock: ffff9c51c243a400/0xcbad34b281571e28 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710951.432325:0:14461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c50c35b0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:14461:1877696177069696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790710951.432392:0:14461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710951.432438:0:14461:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51e4d2f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790710951.432590:0:14459:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177069696 00000100:00100000:2.0:1790710951.432598:0:14459:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177069696 00000100:00100000:2.0:1790710951.432644:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790710951.432664:0:14459:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c529cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+11:14461:x1877696177069696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790710951.432679:0:14459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790710951.432691:0:14459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c51f43f8c00/0xcbad34b281571e2f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbad34b281571e28 expref: -99 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710951.432724:0:14459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c51f43f8c00/0xcbad34b281571e2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbad34b281571e28 expref: 12 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710951.432735:0:14459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c51f43f8c00/0xcbad34b281571e2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281571e28 expref: 12 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710951.432743:0:14459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51f43f8c00, rc 0) 00000100:00100000:2.0:1790710951.432798:0:14459:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c529cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+12:14461:x1877696177069696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710951.432805:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790710951.432869:0:14461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c50c35b0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:14461:1877696177069696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790710951.432883:0:14461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.146@tcp lock: ffff9c51c243a400/0xcbad34b281571e28 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281571e2f expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710951.432892:0:14461:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.146@tcp lock: ffff9c51c243a400/0xcbad34b281571e28 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbad34b281571e2f expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710951.432942:0:14461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d62a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:14461:1877696177069824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790710951.432968:0:14461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710951.432984:0:14461:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f979a780 going to sleep for 11 seconds 00000100:00100000:2.0:1790710951.432996:0:14458:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177069824 00000100:00100000:2.0:1790710951.433000:0:14458:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177069824 00000100:00100000:2.0:1790710951.433021:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790710951.433034:0:14458:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c529d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+12:14461:x1877696177069824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790710951.433279:0:14458:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c529d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+12:14461:x1877696177069824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 245us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710951.433287:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790710951.433322:0:14461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d62a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:14461:1877696177069824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790710951.433348:0:14461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d62a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:14461:1877696177069952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790710951.433385:0:14461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710951.433399:0:14461:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f979a780 going to sleep for 11 seconds 00000100:00100000:2.0:1790710951.433410:0:14458:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177069952 00000100:00100000:2.0:1790710951.433414:0:14458:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177069952 00000100:00100000:2.0:1790710951.433434:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790710951.433440:0:14458:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4708850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+12:14461:x1877696177069952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790710951.433565:0:14458:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4708850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+12:14461:x1877696177069952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 124us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710951.433572:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790710951.433609:0:14461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d62a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:14461:1877696177069952:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1790710951.439391:0:14978:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1790710951.439643:0:14461:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1790710951.439663:0:14461:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790710951.439674:0:14461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c243a400/0xcbad34b281571e28 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281571e2f expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710951.439685:0:14461:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.146@tcp lock: ffff9c51c243a400/0xcbad34b281571e28 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281571e2f expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710952.073607:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790710953.097718:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790710953.735439:0:3308:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790710943/real 1790710943] req@ffff9c51f4d60000 x1877696177066624/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790710953 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790710953.735470:0:3308:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c51f4d60000 x1877696177066624/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790710953 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790710953.735480:0:3308:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790710943/real 1790710943] req@ffff9c51f4d60700 x1877696177066496/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790710953 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790710953.735500:0:3308:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c51f4d60700 x1877696177066496/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790710953 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1790710953.735518:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9c51d02d9800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790710953.735543:0:3308:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00080000:0.0:1790710953.735676:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790710953.735680:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790710953.735682:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790710953.735685:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1790710953.735693:0:37:0:(import.c:65:import_set_state_nolock()) ffff9c51d02d9800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790710953.735698:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 420 00000100:00080000:0.0:1790710953.735717:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1790710953.735727:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c51d02d9800 using connection 192.168.206.146@tcp/0@lo 00000100:00100000:0.0:1790710953.735750:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c50c35b1f80 x1877696177070208/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790710953.735783:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c50c35b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:3309:1877696177070080:0@lo:400:kworker.0 00000100:00100000:0.0:1790710953.735846:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710953.735891:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790710953.735897:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c50c35b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877696177070336:0@lo:400:kworker.0 00000100:00100000:0.0:1790710953.735927:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710953.735959:0:14458:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177070080 00000100:00100000:0.0:1790710953.735966:0:14458:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177070080 00000100:00100000:3.0:1790710953.736153:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1877696177066624:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1790710953.736162:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9c51f444d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790710953.736171:0:3308:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1790710953.736175:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1877696177066496:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1790710953.736196:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c50c35b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1877696177070208:0@lo:8:kworker.0 00000400:00000100:3.0:1790710953.736223:0:3308:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877696177070208 offset 0 length 520: 4 00000100:00080000:3.0:1790710953.736245:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790710953.736249:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1790710953.736251:0:37:0:(import.c:65:import_set_state_nolock()) ffff9c51f444d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790710953.736254:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 420 00000100:00080000:3.0:1790710953.736257:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1790710953.736261:0:37:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c51f444d800 using connection 192.168.206.146@tcp/0@lo 00000100:00100000:3.0:1790710953.736286:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c51c75de680 x1877696177070464/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790710953.736310:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c75de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1877696177070464:0@lo:8:kworker.0 00000400:00000100:3.0:1790710953.736358:0:3308:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877696177070464 offset 0 length 520: 4 00000100:00100000:0.0:1790710953.737013:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790710953.737026:0:14458:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4708450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+12:3309:x1877696177070080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790710953.737093:0:14458:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4708450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+12:3309:x1877696177070080:12345-0@lo:400:kworker.0 Request processed in 71us (1247us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710953.737100:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790710953.737163:0:14465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177070336 00000100:00100000:0.0:1790710953.737168:0:14465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177070336 00000100:00100000:0.0:1790710953.737196:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790710953.737203:0:14465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c50c35b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877696177070336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790710953.737238:0:14465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c50c35b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877696177070336:12345-0@lo:400:kworker.0 Request processed in 36us (1311us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710953.737245:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1790710953.737489:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c50c35b2680 x1877696177070336/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790710969 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790710953.737502:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c50c35b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877696177070336:0@lo:400:kworker.0 00000100:00100000:1.0:1790710953.737513:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c50c35b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:3309:1877696177070080:0@lo:400:kworker.0 00000020:01000004:3.0:1790710953.804258:0:15146:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1790710953.804262:0:15146:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1790710953.804405:0:15146:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c51f8c95000 00000020:01000004:3.0:1790710953.804420:0:15146:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1790710953.804431:0:15146:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1790710953.804444:0:15146:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9c51f97ccd40) 00000020:00000080:3.0:1790710953.804458:0:15146:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1790710953.821955:0:15146:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1790710953.822499:0:15146:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1790710953.823387:0:15146:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1790710953.823636:0:15146:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1790710953.823883:0:15146:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1790710953.824281:0:15146:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:3.0:1790710953.824380:0:15146:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:3.0:1790710953.824477:0:15146:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:3.0:1790710953.827072:0:15146:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 336: rc = 0 00100000:10000000:3.0:1790710953.827596:0:15146:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 336: rc = 0 00100000:10000000:3.0:1790710953.827988:0:15146:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 336: rc = 0 00100000:10000000:3.0:1790710953.828566:0:15146:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 336: rc = 0 00100000:10000000:3.0:1790710953.828945:0:15146:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 336: rc = 0 00100000:10000000:3.0:1790710953.829227:0:15146:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 336: rc = 0 00000020:00000080:3.0:1790710953.831581:0:15146:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1790710953.831593:0:15146:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1790710953.831603:0:15146:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xcbad34b281571e3d 00000020:01000004:3.0:1790710953.831610:0:15146:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1790710953.831629:0:15146:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.146@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1790710953.831633:0:15146:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.146@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1790710953.831641:0:15146:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1790710953.831644:0:15146:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1790710953.831664:0:15146:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9c51f6504d40) 00000020:00000080:3.0:1790710953.831675:0:15146:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:1.0:1790710953.835861:0:15146:0:(service.c:173:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790710953.836044:0:15146:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1790710953.836050:0:15146:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1790710953.838695:0:15146:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1790710953.838717:0:15146:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1790710953.843434:0:15146:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1790710953.843452:0:15146:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1790710953.845285:0:15146:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790710953.845470:0:15146:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1790710953.845475:0:15146:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1790710953.847741:0:15146:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1790710953.847758:0:15146:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1790710953.874707:0:15146:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790710953.874940:0:15146:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1790710953.874946:0:15146:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1790710953.876222:0:15146:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1790710953.876233:0:15146:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1790710953.877722:0:15146:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1790710953.879579:0:15146:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1790710953.886313:0:15146:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790710953.887615:0:15146:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1790710953.887626:0:15146:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1790710953.889614:0:15146:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1790710953.889627:0:15146:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1790710953.929380:0:15146:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790710953.929569:0:15146:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1790710953.929576:0:15146:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1790710953.930966:0:15146:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1790710953.930977:0:15146:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1790710953.931573:0:15146:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1790710953.931595:0:15146:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1790710953.931600:0:15146:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.146@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1790710953.942476:0:15146:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.146@tcp ctxt 0 is initialized 00000020:01000004:2.0:1790710953.942515:0:15146:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.146@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1790710953.942520:0:15146:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1790710953.942522:0:15146:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790710953.942523:0:15146:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790710953.942524:0:15146:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790710953.942525:0:15146:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790710953.942526:0:15146:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790710953.942527:0:15146:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790710953.942529:0:15146:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790710953.942531:0:15146:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790710953.942534:0:15146:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1790710953.942536:0:15146:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790710953.942537:0:15146:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790710953.942538:0:15146:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790710953.942539:0:15146:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790710953.942540:0:15146:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790710953.942541:0:15146:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790710953.942542:0:15146:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790710953.942543:0:15146:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790710953.942544:0:15146:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790710953.942570:0:15146:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1790710953.942590:0:15146:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d62a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:15146:1877696177070592:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1790710953.942746:0:15146:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710953.942871:0:15146:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f9b2d180 going to sleep for 11 seconds 00000100:00100000:0.0:1790710953.943018:0:14457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177070592 00000100:00100000:0.0:1790710953.943026:0:14457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177070592 00000100:00100000:0.0:1790710953.943118:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790710953.943150:0:14457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f470a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+12:15146:x1877696177070592:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1790710953.943180:0:14457:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1790710953.943184:0:14457:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1790710953.943188:0:14457:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1790710953.952535:0:14457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f470a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+12:15146:x1877696177070592:12345-0@lo:253:mount.lustre.0 Request processed in 9399us (9780us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710953.952578:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790710953.952836:0:15146:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d62a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:15146:1877696177070592:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1790710953.952852:0:15146:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1790710953.952856:0:15146:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790710953.952857:0:15146:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1790710953.952859:0:15146:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790710953.952859:0:15146:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790710953.952861:0:15146:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790710953.952862:0:15146:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790710953.952863:0:15146:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790710953.952865:0:15146:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790710953.952873:0:15146:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1790710953.952900:0:15146:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c51f8c95000 from lustre-OST0000 10000000:01000000:1.0:1790710953.952930:0:15146:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1790710953.952933:0:15146:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1790710953.952939:0:15146:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9c51fa0e0000 local copy 00010000:00010000:1.0:1790710953.952950:0:15146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c243b800/0xcbad34b281571d33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281571d3a expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710953.953310:0:15146:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51ff87f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:15146:1877696177070720:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790710953.953352:0:15146:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710953.953431:0:15146:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51d90c46c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790710953.953477:0:14459:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177070720 00000100:00100000:2.0:1790710953.953483:0:14459:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177070720 00000100:00100000:2.0:1790710953.953569:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790710953.953578:0:14459:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f470b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+12:15146:x1877696177070720:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790710953.953941:0:14459:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f470b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+12:15146:x1877696177070720:12345-0@lo:501:mount.lustre.0 Request processed in 363us (588us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790710953.953949:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790710953.954110:0:15146:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51ff87f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:15146:1877696177070720:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1790710953.954151:0:15146:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.146@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1790710953.954306:0:15146:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.146@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1790710953.954314:0:15146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c243b800/0xcbad34b281571d33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281571d3a expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710953.954324:0:15146:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.146@tcp lock: ffff9c51c243b800/0xcbad34b281571d33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281571d3a expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790710953.954348:0:15146:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c51f8c95000 10000000:01000000:1.0:1790710953.954352:0:15146:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1790710953.954357:0:15146:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9c51fa0e0000 10000000:01000000:1.0:1790710953.954360:0:15146:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1790710953.954363:0:15146:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9c51fa0e0000 from 1 10000000:01000000:1.0:1790710953.954366:0:15146:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1790710953.954391:0:15146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c6481000/0xcbad34b281571e4b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710953.954398:0:15146:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.146@tcp lock: ffff9c51c6481000/0xcbad34b281571e4b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710953.954415:0:15146:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.146@tcp lock: ffff9c51c6481000/0xcbad34b281571e4b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710953.954430:0:15146:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51ff87f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:15146:1877696177070848:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790710953.954461:0:15146:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710953.954495:0:15146:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51d90c46c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790710953.954669:0:14457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177070848 00000100:00100000:0.0:1790710953.954675:0:14457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177070848 00000100:00100000:0.0:1790710953.954723:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790710953.954731:0:14457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f470a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+12:15146:x1877696177070848:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790710953.954741:0:14457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790710953.954754:0:14457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c51c243b200/0xcbad34b281571e52 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbad34b281571e4b expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710953.954785:0:14457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c51c243b200/0xcbad34b281571e52 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbad34b281571e4b expref: 13 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710953.954797:0:14457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c51c243b200/0xcbad34b281571e52 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281571e4b expref: 13 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710953.954805:0:14457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c243b200, rc 0) 00000100:00100000:0.0:1790710953.954851:0:14457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f470a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+13:15146:x1877696177070848:12345-0@lo:101:mount.lustre.0 Request processed in 120us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710953.954866:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790710953.955060:0:15146:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51ff87f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:15146:1877696177070848:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790710953.955074:0:15146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.146@tcp lock: ffff9c51c6481000/0xcbad34b281571e4b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281571e52 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710953.955083:0:15146:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.146@tcp lock: ffff9c51c6481000/0xcbad34b281571e4b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbad34b281571e52 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790710953.955110:0:15146:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.146@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1790710953.955145:0:15146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c6481000/0xcbad34b281571e4b lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281571e52 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710953.955152:0:15146:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.146@tcp lock: ffff9c51c6481000/0xcbad34b281571e4b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281571e52 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790710953.955159:0:15146:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1790710953.955163:0:15146:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790710953.955167:0:15146:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1790710953.955170:0:15146:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1790710953.955185:0:15146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c8047400/0xcbad34b281571e59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710953.955193:0:15146:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.146@tcp lock: ffff9c51c8047400/0xcbad34b281571e59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710953.955200:0:15146:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.146@tcp lock: ffff9c51c8047400/0xcbad34b281571e59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710953.955224:0:15146:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c75df480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:15146:1877696177070976:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790710953.955255:0:15146:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710953.955277:0:15146:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c8189b40 going to sleep for 11 seconds 00000100:00100000:0.0:1790710953.955388:0:14457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177070976 00000100:00100000:0.0:1790710953.955394:0:14457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177070976 00000100:00100000:0.0:1790710953.955412:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1790710953.955417:0:14457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f470bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+13:15146:x1877696177070976:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790710953.955424:0:14457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790710953.955431:0:14457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c51c243b600/0xcbad34b281571e60 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbad34b281571e59 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710953.955445:0:14457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c51c243b600/0xcbad34b281571e60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbad34b281571e59 expref: 14 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710953.955452:0:14457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c51c243b600/0xcbad34b281571e60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281571e59 expref: 14 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710953.955458:0:14457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c243b600, rc 0) 00000100:00100000:0.0:1790710953.955495:0:14457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f470bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+14:15146:x1877696177070976:12345-0@lo:101:mount.lustre.0 Request processed in 76us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710953.955500:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1790710953.955774:0:15146:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c75df480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:15146:1877696177070976:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790710953.955786:0:15146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.146@tcp lock: ffff9c51c8047400/0xcbad34b281571e59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281571e60 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710953.955794:0:15146:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.146@tcp lock: ffff9c51c8047400/0xcbad34b281571e59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbad34b281571e60 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790710953.956845:0:15146:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1790710953.958756:0:15146:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790710953.959019:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1790710953.959078:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1790710953.959831:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1790710953.959926:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1790710953.959970:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1790710953.960423:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1790710953.960589:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1790710953.960598:0:15146:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1790710953.960682:0:15146:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c75df480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:15146:1877696177071104:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790710953.960934:0:15146:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710953.961042:0:15146:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c8189600 going to sleep for 11 seconds 00000100:00100000:0.0:1790710953.961088:0:14457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177071104 00000100:00100000:0.0:1790710953.961097:0:14457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177071104 00000100:00100000:0.0:1790710953.961347:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1790710953.961357:0:14457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4709450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+14:15146:x1877696177071104:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790710953.963986:0:14457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4709450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+14:15146:x1877696177071104:12345-0@lo:501:mount.lustre.0 Request processed in 2623us (3044us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710953.964064:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790710953.964209:0:15146:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c75df480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:15146:1877696177071104:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790710953.964262:0:15146:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c75df480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:15146:1877696177071232:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790710953.964316:0:15146:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710953.964356:0:15146:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c8189600 going to sleep for 11 seconds 00000100:00100000:2.0:1790710953.964421:0:14459:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177071232 00000100:00100000:2.0:1790710953.964428:0:14459:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177071232 00000100:00100000:2.0:1790710953.964470:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1790710953.964478:0:14459:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4708c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+14:15146:x1877696177071232:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790710953.964808:0:14459:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4708c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+14:15146:x1877696177071232:12345-0@lo:503:mount.lustre.0 Request processed in 328us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710953.964815:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1790710953.965041:0:15146:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c75df480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:15146:1877696177071232:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1790710953.965850:0:15146:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790710953.965921:0:15146:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c75df480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:15146:1877696177071360:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790710953.965979:0:15146:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710953.966079:0:15146:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c8189600 going to sleep for 11 seconds 00000100:00100000:0.0:1790710953.966240:0:14457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177071360 00000100:00100000:0.0:1790710953.966253:0:14457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177071360 00000100:00100000:0.0:1790710953.966323:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1790710953.966331:0:14457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f470ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+14:15146:x1877696177071360:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790710953.966564:0:14457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f470ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+14:15146:x1877696177071360:12345-0@lo:502:mount.lustre.0 Request processed in 233us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710953.966571:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1790710953.966652:0:15146:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c75df480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:15146:1877696177071360:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790710953.966894:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1790710953.966948:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1790710953.966992:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1790710953.967054:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1790710953.967095:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1790710953.967171:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1790710953.967222:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1790710953.967258:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1790710953.967289:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1790710953.967335:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1790710953.967370:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1790710953.967426:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1790710953.967460:0:15146:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c75df480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:15146:1877696177071488:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790710953.967513:0:15146:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710953.967780:0:15146:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c8189600 going to sleep for 11 seconds 00000100:00100000:2.0:1790710953.967823:0:14459:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177071488 00000100:00100000:2.0:1790710953.967829:0:14459:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177071488 00000100:00100000:2.0:1790710953.967863:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790710953.967871:0:14459:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f470b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+14:15146:x1877696177071488:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790710953.968056:0:14459:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f470b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+14:15146:x1877696177071488:12345-0@lo:502:mount.lustre.0 Request processed in 186us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710953.968064:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1790710953.968348:0:15146:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c75df480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:15146:1877696177071488:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790710953.968422:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1790710953.968432:0:15146:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:1.0:1790710953.969402:0:15160:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1790710953.969410:0:15160:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1790710953.969416:0:15160:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790710953.969418:0:15160:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1790710953.969423:0:15160:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790710953.969436:0:15160:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9c51c81b99c0) 00000020:00000080:1.0:1790710953.969452:0:15160:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:1.0:1790710953.969456:0:15160:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1790710953.969516:0:15160:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c51f8c95000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1790710953.969523:0:15160:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1790710953.969529:0:15160:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xcbad34b281571e6e 00010000:00010000:1.0:1790710953.973403:0:15160:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:1.0:1790710953.973919:0:15160:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:1.0:1790710953.975911:0:15160:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1790710953.977326:0:15160:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1790710953.977336:0:15160:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790710953.977343:0:15160:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790710953.977345:0:15160:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1790710953.977354:0:15160:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1790710953.977357:0:15160:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1790710953.977358:0:15160:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790710953.977360:0:15160:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790710953.977362:0:15160:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1790710953.977364:0:15160:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790710953.977365:0:15160:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1790710953.977367:0:15160:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790710953.977370:0:15160:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790710953.977371:0:15160:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1790710953.977374:0:15160:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1790710953.977376:0:15160:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1790710953.977377:0:15160:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790710953.977379:0:15160:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790710953.977381:0:15160:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:2.0:1790710953.977383:0:15160:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790710953.977385:0:15160:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790710953.977386:0:15160:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1790710953.977389:0:15160:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1790710953.977440:0:15160:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790710953.977444:0:15160:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790710953.977445:0:15160:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1790710953.977448:0:15160:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:0.0:1790710953.977722:0:15146:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1790710953.977750:0:15146:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.146@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1790710953.977773:0:15146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c8047400/0xcbad34b281571e59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281571e60 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710953.977786:0:15146:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.146@tcp lock: ffff9c51c8047400/0xcbad34b281571e59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281571e60 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790710953.977794:0:15146:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c51f8c95000 from 1 10000000:01000000:0.0:1790710953.977797:0:15146:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790710953.977830:0:15146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c243ac00/0xcbad34b281571e75 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710953.977838:0:15146:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.146@tcp lock: ffff9c51c243ac00/0xcbad34b281571e75 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710953.977849:0:15146:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.146@tcp lock: ffff9c51c243ac00/0xcbad34b281571e75 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710953.977873:0:15146:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c50c35b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:15146:1877696177071616:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790710953.977938:0:15146:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710953.977970:0:15146:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f979ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1790710953.979221:0:14459:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177071616 00000100:00100000:2.0:1790710953.979233:0:14459:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177071616 00000100:00100000:2.0:1790710953.979274:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1790710953.979282:0:14459:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4708050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+14:15146:x1877696177071616:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790710953.979297:0:14459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790710953.979313:0:14459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c51f43f9e00/0xcbad34b281571e7c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbad34b281571e75 expref: -99 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710953.979337:0:14459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c51f43f9e00/0xcbad34b281571e7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbad34b281571e75 expref: 15 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710953.979360:0:14459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c51f43f9e00/0xcbad34b281571e7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281571e75 expref: 15 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710953.979368:0:14459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51f43f9e00, rc 0) 00000100:00100000:2.0:1790710953.979426:0:14459:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4708050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+15:15146:x1877696177071616:12345-0@lo:101:mount.lustre.0 Request processed in 144us (1488us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710953.979433:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1790710953.979561:0:15146:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c50c35b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:15146:1877696177071616:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790710953.979585:0:15146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.146@tcp lock: ffff9c51c243ac00/0xcbad34b281571e75 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281571e7c expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710953.979594:0:15146:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.146@tcp lock: ffff9c51c243ac00/0xcbad34b281571e75 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbad34b281571e7c expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790710953.980165:0:15146:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1790710953.980647:0:15146:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790710953.980878:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1790710953.980921:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1790710953.980984:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1790710953.980992:0:15146:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1790710953.981051:0:15146:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c50c35b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:15146:1877696177071744:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790710953.981104:0:15146:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710953.981164:0:15146:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f979ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1790710953.981520:0:14457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177071744 00000100:00100000:2.0:1790710953.981527:0:14457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177071744 00000100:00100000:2.0:1790710953.981574:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790710953.981583:0:14457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4709c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+15:15146:x1877696177071744:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790710953.981794:0:14457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4709c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+15:15146:x1877696177071744:12345-0@lo:501:mount.lustre.0 Request processed in 211us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710953.981802:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1790710953.984293:0:15146:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c50c35b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:15146:1877696177071744:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790710953.984354:0:15146:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c50c35b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:15146:1877696177071872:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790710953.984422:0:15146:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710953.984500:0:15146:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f979ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1790710953.987482:0:14458:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177071872 00000100:00100000:1.0:1790710953.987498:0:14458:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177071872 00000100:00100000:1.0:1790710953.987648:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1790710953.987661:0:14458:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f470b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+15:15146:x1877696177071872:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790710953.987913:0:14458:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f470b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+15:15146:x1877696177071872:12345-0@lo:503:mount.lustre.0 Request processed in 254us (3491us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710953.987976:0:15146:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c50c35b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:15146:1877696177071872:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790710953.988410:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000040:00080000:3.0:1790710953.988750:0:15146:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790710953.988839:0:15146:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c75df480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:15146:1877696177072000:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790710953.988891:0:15146:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710953.988933:0:15146:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c8189600 going to sleep for 11 seconds 00000100:00100000:0.0:1790710953.989033:0:14459:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177072000 00000100:00100000:0.0:1790710953.989039:0:14459:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177072000 00000100:00100000:0.0:1790710953.989078:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1790710953.989086:0:14459:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4709050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+15:15146:x1877696177072000:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790710953.989303:0:14459:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4709050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+15:15146:x1877696177072000:12345-0@lo:502:mount.lustre.0 Request processed in 217us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710953.989310:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790710953.989481:0:15146:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c75df480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:15146:1877696177072000:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790710953.989727:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1790710953.989774:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1790710953.989812:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1790710953.989848:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1790710953.989877:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1790710953.989911:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1790710953.989937:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1790710953.989961:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1790710953.989983:0:15146:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c75df480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:15146:1877696177072128:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790710953.990032:0:15146:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710953.990062:0:15146:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c8189600 going to sleep for 11 seconds 00000100:00100000:1.0:1790710953.990277:0:14458:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177072128 00000100:00100000:1.0:1790710953.990288:0:14458:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177072128 00000100:00100000:1.0:1790710953.990357:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1790710953.990365:0:14458:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4709850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+15:15146:x1877696177072128:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790710953.990521:0:14458:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4709850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+15:15146:x1877696177072128:12345-0@lo:502:mount.lustre.0 Request processed in 156us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710953.990528:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1790710953.990612:0:15146:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c75df480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:15146:1877696177072128:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790710953.990713:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1790710953.990724:0:15146:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1790710953.991890:0:15164:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790710953.991904:0:15164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790710953.991906:0:15164:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1790710953.991913:0:15164:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c51f8c95000 00000020:00000080:1.0:1790710953.991915:0:15164:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790710953.991922:0:15164:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790710953.991924:0:15164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790710953.991926:0:15164:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1790710953.991928:0:15164:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790710953.991931:0:15164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790710953.991932:0:15164:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1790710953.991935:0:15164:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c51f8c95000 00000020:00000080:1.0:1790710953.991937:0:15164:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790710953.992027:0:15164:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790710953.992031:0:15164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790710953.992033:0:15164:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1790710953.992035:0:15164:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790710953.992038:0:15164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790710953.992039:0:15164:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1790710953.992043:0:15164:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c51f8c95000 00000020:00000080:1.0:1790710953.992045:0:15164:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790710953.992397:0:15164:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790710953.992401:0:15164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790710953.992403:0:15164:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1790710953.992406:0:15164:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1790710953.992812:0:15146:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1790710953.992839:0:15146:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790710953.992863:0:15146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c243ac00/0xcbad34b281571e75 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281571e7c expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710953.992875:0:15146:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.146@tcp lock: ffff9c51c243ac00/0xcbad34b281571e75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281571e7c expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790710953.992920:0:15146:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1790710953.992923:0:15146:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c51f8c95000 10000000:01000000:2.0:1790710953.992926:0:15146:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c51f8c95000 10000000:01000000:2.0:1790710953.992930:0:15146:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790710953.992935:0:15146:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c51f8c95000 from 1 10000000:01000000:2.0:1790710953.992942:0:15146:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790710953.992974:0:15146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51f43f8600/0xcbad34b281571e83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710953.992982:0:15146:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.146@tcp lock: ffff9c51f43f8600/0xcbad34b281571e83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710953.992990:0:15146:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.146@tcp lock: ffff9c51f43f8600/0xcbad34b281571e83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710953.993012:0:15146:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d63480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:15146:1877696177072256:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790710953.993070:0:15146:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710953.993368:0:14457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177072256 00000100:00100000:2.0:1790710953.993376:0:14457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177072256 00000100:00100000:2.0:1790710953.993422:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790710953.993430:0:14457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f470a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+15:15146:x1877696177072256:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790710953.993442:0:14457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790710953.993454:0:14457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c51f43f9800/0xcbad34b281571e8a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbad34b281571e83 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710953.993488:0:14457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c51f43f9800/0xcbad34b281571e8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbad34b281571e83 expref: 16 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710953.993500:0:14457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c51f43f9800/0xcbad34b281571e8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281571e83 expref: 16 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710953.993508:0:14457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51f43f9800, rc 0) 00000100:00100000:2.0:1790710953.993543:0:14457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f470a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+16:15146:x1877696177072256:12345-0@lo:101:mount.lustre.0 Request processed in 113us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710953.993561:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790710953.993617:0:15146:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f9b2d180 going to sleep for 11 seconds 00000100:00100000:2.0:1790710953.993637:0:15146:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d63480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:15146:1877696177072256:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790710953.993652:0:15146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.146@tcp lock: ffff9c51f43f8600/0xcbad34b281571e83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281571e8a expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710953.993661:0:15146:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.146@tcp lock: ffff9c51f43f8600/0xcbad34b281571e83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbad34b281571e8a expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790710953.994256:0:15146:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1790710953.994781:0:15146:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790710953.995050:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1790710953.995291:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1790710953.995338:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1790710953.995391:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1790710953.995428:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1790710953.995654:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1790710953.995724:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1790710953.995894:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1790710953.995949:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1790710953.995986:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1790710953.996018:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1790710953.996069:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1790710953.997304:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1790710953.997386:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1790710953.997522:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1790710953.997656:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1790710953.997716:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1790710953.997785:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1790710953.997832:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1790710953.997882:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1790710953.997972:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1790710953.998026:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1790710954.001392:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1790710954.001538:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1790710954.001679:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1790710954.001729:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1790710954.001783:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1790710954.001814:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1790710954.001893:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1790710954.001899:0:15146:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1790710954.002010:0:15146:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d63480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:15146:1877696177072384:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790710954.002075:0:15146:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710954.002786:0:15146:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f9b2d180 going to sleep for 11 seconds 00000100:00100000:3.0:1790710954.004275:0:14458:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177072384 00000100:00100000:3.0:1790710954.004288:0:14458:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177072384 00000100:00100000:3.0:1790710954.004338:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1790710954.004348:0:14458:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f470fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+16:15146:x1877696177072384:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790710954.005791:0:14458:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f470fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+16:15146:x1877696177072384:12345-0@lo:501:mount.lustre.0 Request processed in 1439us (3710us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710954.005802:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790710954.009749:0:15146:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d63480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:15146:1877696177072384:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790710954.009809:0:15146:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d63480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:15146:1877696177072512:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790710954.009885:0:15146:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710954.009927:0:14457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177072512 00000100:00100000:2.0:1790710954.009933:0:14457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177072512 00000100:00100000:2.0:1790710954.009986:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790710954.009997:0:14457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f470d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+16:15146:x1877696177072512:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790710954.010217:0:14457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f470d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+16:15146:x1877696177072512:12345-0@lo:503:mount.lustre.0 Request processed in 220us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710954.010226:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790710954.010278:0:15146:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f9b2d180 going to sleep for 11 seconds 00000100:00100000:2.0:1790710954.010292:0:15146:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d63480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:15146:1877696177072512:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1790710954.011694:0:15146:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790710954.011799:0:15146:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51ff87ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:15146:1877696177072640:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790710954.011867:0:15146:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710954.011906:0:15146:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f4013600 going to sleep for 11 seconds 00000100:00100000:3.0:1790710954.011931:0:14459:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177072640 00000100:00100000:3.0:1790710954.011938:0:14459:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177072640 00000100:00100000:3.0:1790710954.011988:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1790710954.011996:0:14459:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f470cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+16:15146:x1877696177072640:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790710954.012229:0:14459:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f470cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+16:15146:x1877696177072640:12345-0@lo:502:mount.lustre.0 Request processed in 233us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710954.012236:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1790710954.012421:0:15146:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51ff87ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:15146:1877696177072640:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790710954.012848:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1790710954.012909:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1790710954.012961:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1790710954.013012:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1790710954.013052:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1790710954.013298:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1790710954.013343:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1790710954.013380:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1790710954.013439:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1790710954.013797:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1790710954.013832:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1790710954.013884:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1790710954.013923:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1790710954.013959:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1790710954.014007:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1790710954.014043:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1790710954.014079:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1790710954.014396:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1790710954.014431:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1790710954.014458:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1790710954.014498:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1790710954.014535:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1790710954.014669:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1790710954.014735:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1790710954.014772:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1790710954.014827:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1790710954.014885:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1790710954.014923:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1790710954.014958:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1790710954.015000:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1790710954.015037:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1790710954.015071:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1790710954.015120:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1790710954.015641:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1790710954.015682:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1790710954.015745:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1790710954.015779:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1790710954.015828:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1790710954.015877:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1790710954.015910:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1790710954.015957:0:15146:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51ff87c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:15146:1877696177072768:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790710954.016026:0:15146:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710954.016153:0:15146:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f4013600 going to sleep for 11 seconds 00000100:00100000:2.0:1790710954.016335:0:14457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177072768 00000100:00100000:2.0:1790710954.016343:0:14457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177072768 00000100:00100000:2.0:1790710954.016403:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1790710954.016413:0:14457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f470ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+16:15146:x1877696177072768:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790710954.016750:0:14457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f470ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+16:15146:x1877696177072768:12345-0@lo:502:mount.lustre.0 Request processed in 338us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710954.016759:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1790710954.016855:0:15146:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51ff87c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:15146:1877696177072768:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790710954.016932:0:15146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1790710954.016942:0:15146:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1790710954.018118:0:15169:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1790710954.018170:0:15169:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9c51fa3d19c0) 00000020:00000080:1.0:1790710954.018191:0:15169:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1790710954.018261:0:15169:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c51f8c95000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1790710954.018265:0:15169:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c51f8c95000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1790710954.018267:0:15169:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c51f8c95000 3 00010000:00080000:1.0:1790710954.018294:0:15169:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c51c7e37800@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.146@tcp at head 00010000:00010000:1.0:1790710954.023930:0:15169:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:1.0:1790710954.024280:0:15169:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1790710954.024318:0:15169:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1790710954.024330:0:15169:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xcbad34b281571e98 00000100:00080000:1.0:1790710954.024339:0:15169:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790710954.024348:0:15169:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c51c7e37800 using connection 192.168.206.146@tcp/0@lo 00000100:00100000:1.0:1790710954.024381:0:15169:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c51ff87c000 x1877696177072896/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790710954.024406:0:15169:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1790710954.025266:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51ff87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3308:1877696177072896:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1790710954.025344:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710954.025451:0:14464:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177072896 00000100:00100000:3.0:1790710954.025459:0:14464:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177072896 00000100:00100000:3.0:1790710954.025496:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790710954.025503:0:14464:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff87ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3308:x1877696177072896:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1790710954.025529:0:14464:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 431 last 0 00000020:00000080:3.0:1790710954.029318:0:14464:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xcbad34b281571e9f 00000004:00100000:3.0:1790710954.029335:0:14464:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1790710954.029370:0:14464:0:(import.c:65:import_set_state_nolock()) ffff9c51c6520000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790710954.029458:0:14464:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff87ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877696177072896:12345-0@lo:38:llog_process_th.0 Request processed in 3951us (4111us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710954.029468:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1790710954.029620:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c51ff87c000 x1877696177072896/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790710964 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790710954.029637:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790710954.029645:0:3308:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1790710954.029652:0:3308:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1790710954.029656:0:3308:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1790710954.029658:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9c51c7e37800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1790710954.029663:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51ff87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3308:1877696177072896:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1790710954.030379:0:15169:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1790710954.030468:0:15146:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1790710954.030493:0:15146:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790710954.030517:0:15146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51f43f8600/0xcbad34b281571e83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281571e8a expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710954.030527:0:15146:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.146@tcp lock: ffff9c51f43f8600/0xcbad34b281571e83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281571e8a expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1790710954.030638:0:15146:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1790710954.030641:0:15146:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790710954.030642:0:15146:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790710954.030643:0:15146:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790710954.030645:0:15146:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790710954.030646:0:15146:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790710954.030648:0:15146:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790710954.030649:0:15146:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790710954.030651:0:15146:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790710954.030654:0:15146:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1790710954.030656:0:15146:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790710954.030657:0:15146:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790710954.030659:0:15146:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790710954.030660:0:15146:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790710954.030660:0:15146:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790710954.030662:0:15146:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790710954.030663:0:15146:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790710954.030664:0:15146:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790710954.030665:0:15146:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790710954.030685:0:15146:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1790710954.030718:0:15146:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d63480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:15146:1877696177073024:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1790710954.030770:0:15146:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710954.030809:0:15146:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51ff9fa000 going to sleep for 11 seconds 00000100:00100000:0.0:1790710954.031040:0:14458:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177073024 00000100:00100000:0.0:1790710954.031047:0:14458:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177073024 00000100:00100000:0.0:1790710954.031105:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1790710954.031114:0:14458:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f470f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+16:15146:x1877696177073024:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1790710954.031305:0:14458:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1790710954.031319:0:14458:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1790710954.067958:0:14458:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1790710954.067978:0:14458:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1790710954.068030:0:14480:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1790710954.068034:0:14480:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1790710954.068054:0:14480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c51f43f9c00/0xcbad34b281571ea6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710954.068072:0:14480:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c51c8046200/0xcbad34b281571e13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281571e0c expref: 16 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710954.068080:0:14480:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c51f43f9c00/0xcbad34b281571ea6 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710954.068149:0:14480:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c51c8046200/0xcbad34b281571e13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbad34b281571e0c expref: 16 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710954.068162:0:14480:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c51c8046200/0xcbad34b281571e13 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbad34b281571e0c expref: 16 pid: 14458 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710954.068176:0:14480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d61880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14480:1877696177073152:0@lo:104: 00000100:00100000:2.0:1790710954.068239:0:14480:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710954.068283:0:14480:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f4013600 going to sleep for 11 seconds 00000100:00100000:0.0:1790710954.069779:0:14448:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177073152 00000100:00100000:0.0:1790710954.069793:0:14448:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177073152 00000100:00100000:0.0:1790710954.069837:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790710954.069846:0:14448:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d63b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+3:14480:x1877696177073152:12345-0@lo:104: 00010000:00010000:0.0:1790710954.069863:0:14448:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.146@tcp lock: ffff9c51c243a200/0xcbad34b281571e0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbad34b281571e13 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710954.069939:0:14448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790710954.069946:0:14448:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d63b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+3:14480:x1877696177073152:12345-0@lo:104: Request processed in 101us (1707us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710954.069952:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1790710954.070233:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790710954.070252:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.146@tcp lock: ffff9c51c243a200/0xcbad34b281571e0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbad34b281571e13 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710954.070260:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c243a200 already unused, calling callback (ffffffffc1cdfc20) 10000000:00010000:0.0:1790710954.070263:0:14453:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.146@tcp lock: ffff9c51c243a200/0xcbad34b281571e0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbad34b281571e13 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710954.070271:0:14453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.146@tcp lock: ffff9c51c243a200/0xcbad34b281571e0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbad34b281571e13 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790710954.070277:0:14453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.146@tcp lock: ffff9c51c243a200/0xcbad34b281571e0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbad34b281571e13 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790710954.070282:0:14453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1790710954.070322:0:14453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.146@tcp lock: ffff9c51c243a200/0xcbad34b281571e0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281571e13 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710954.070329:0:14453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790710954.070348:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.146@tcp lock: ffff9c51c243a200/0xcbad34b281571e0c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281571e13 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710954.070355:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.146@tcp lock: ffff9c51c243a200/0xcbad34b281571e0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281571e13 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710954.070373:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790710954.070375:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790710954.070376:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790710954.070402:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c50c35b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:3311:1877696177073280:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790710954.070441:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710954.070689:0:14451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177073280 00000100:00100000:3.0:1790710954.070695:0:14451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177073280 00010000:00010000:3.0:1790710954.070727:0:14451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c51c8046200/0xcbad34b281571e13 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbad34b281571e0c expref: 17 pid: 14458 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710954.070756:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790710954.070764:0:14451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c50c35b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+17:3311:x1877696177073280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790710954.070776:0:14451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790710954.070782:0:14451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c51c8046200/0xcbad34b281571e13 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbad34b281571e0c expref: 17 pid: 14458 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710954.070805:0:14451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c51c8046200/0xcbad34b281571e13 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbad34b281571e0c expref: 17 pid: 14458 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710954.070821:0:14451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c51f43f9c00/0xcbad34b281571ea6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710954.070830:0:14451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c51f43f9c00/0xcbad34b281571ea6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1790710954.070844:0:14451:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002809584s 00010000:00010000:3.0:1790710954.070848:0:14451:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c51f43f9c00/0xcbad34b281571ea6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710954.070855:0:14451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c51f43f9c00/0xcbad34b281571ea6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710954.070861:0:14451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c51f43f9c00/0xcbad34b281571ea6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710954.070867:0:14451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c51f43f9c00/0xcbad34b281571ea6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710954.070872:0:14451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51f43f9c00 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:3.0:1790710954.070877:0:14451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c51f43f9c00/0xcbad34b281571ea6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710954.070884:0:14451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c51f43f9c00/0xcbad34b281571ea6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710954.070894:0:14451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c51f43f9c00/0xcbad34b281571ea6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710954.070911:0:14451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790710954.070958:0:14451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c50c35b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+17:3311:x1877696177073280:12345-0@lo:103:ldlm_bl.0 Request processed in 194us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710954.070966:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1790710954.071003:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c51c8046200/0xcbad34b281571e13 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbad34b281571e0c expref: 16 pid: 14458 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710954.071016:0:14480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d61880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14480:1877696177073152:0@lo:104: 00010000:00010000:3.0:1790710954.071033:0:14480:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c51f43f9c00/0xcbad34b281571ea6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710954.071042:0:14480:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c51f43f9c00/0xcbad34b281571ea6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710954.071048:0:14480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c51f43f9c00/0xcbad34b281571ea6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710954.071054:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c51f43f9c00/0xcbad34b281571ea6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710954.071244:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c50c35b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:3311:1877696177073280:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790710954.077448:0:14458:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f470f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+15:15146:x1877696177073024:12345-0@lo:253:mount.lustre.0 Request processed in 46327us (46669us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710954.077462:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1790710954.077668:0:15146:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d63480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:15146:1877696177073024:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1790710954.077683:0:15146:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1790710954.077686:0:15146:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790710954.077687:0:15146:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790710954.077689:0:15146:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790710954.077690:0:15146:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790710954.077691:0:15146:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790710954.077692:0:15146:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790710954.077716:0:15146:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790710954.077718:0:15146:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790710954.077719:0:15146:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1790710954.077739:0:15146:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1790710954.085054:0:15146:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1790710954.085875:0:15146:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1790710954.086040:0:15146:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1790710954.086229:0:15146:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1790710954.086377:0:15146:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1790710954.086796:0:15146:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1790710954.087828:0:15146:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:1.0:1790710954.119309:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1790710954.134463:0:15146:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1790710954.134484:0:15146:0:(lfsck_lib.c:3084:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1790710954.134517:0:15146:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1790710954.134590:0:15146:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.146@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1790710954.134602:0:15146:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1790710954.134628:0:15146:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1790710955.144324:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790710955.464422:0:14496:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:1.0:1790710955.591296:0:14461:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1790710955.591304:0:14461:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c51f49a9800 from 7 10000000:01000000:1.0:1790710955.591373:0:14461:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790710955.591421:0:14461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c6480000/0xcbad34b281571ead lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710955.591433:0:14461:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.146@tcp lock: ffff9c51c6480000/0xcbad34b281571ead lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710955.591444:0:14461:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.146@tcp lock: ffff9c51c6480000/0xcbad34b281571ead lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710955.591468:0:14461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51ff87e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:14461:1877696177073408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790710955.591760:0:14461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710955.591868:0:14461:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51ff9fab40 going to sleep for 11 seconds 00000100:00100000:2.0:1790710955.591915:0:14457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177073408 00000100:00100000:2.0:1790710955.591923:0:14457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177073408 00000100:00100000:2.0:1790710955.592074:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1790710955.592084:0:14457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f470c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+15:14461:x1877696177073408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790710955.592097:0:14457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790710955.592110:0:14457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c51f43f8200/0xcbad34b281571eb4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbad34b281571ead expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710955.592163:0:14457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c51f43f8200/0xcbad34b281571eb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbad34b281571ead expref: 16 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710955.592174:0:14457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c51f43f8200/0xcbad34b281571eb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281571ead expref: 16 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710955.592190:0:14457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51f43f8200, rc 0) 00000100:00100000:2.0:1790710955.592233:0:14457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f470c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+16:14461:x1877696177073408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710955.592239:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1790710955.592405:0:14461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51ff87e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:14461:1877696177073408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790710955.592422:0:14461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.146@tcp lock: ffff9c51c6480000/0xcbad34b281571ead lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281571eb4 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710955.592431:0:14461:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.146@tcp lock: ffff9c51c6480000/0xcbad34b281571ead lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbad34b281571eb4 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710955.592485:0:14461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c50c35b0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:14461:1877696177073536:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1790710955.592532:0:14461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710955.592861:0:14461:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51d03b4780 going to sleep for 11 seconds 00000100:00100000:1.0:1790710955.592893:0:14459:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177073536 00000100:00100000:1.0:1790710955.592899:0:14459:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177073536 00000100:00100000:1.0:1790710955.592923:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1790710955.592930:0:14459:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f470dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+16:14461:x1877696177073536:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1790710955.592944:0:14459:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1790710955.592959:0:14459:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1790710955.592962:0:14459:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1790710955.593071:0:14459:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f470dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+16:14461:x1877696177073536:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 139us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710955.593079:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1790710955.593144:0:14461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c50c35b0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:14461:1877696177073536:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1790710955.593210:0:14461:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.146@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790710955.593218:0:14461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c6480000/0xcbad34b281571ead lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281571eb4 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710955.593227:0:14461:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.146@tcp lock: ffff9c51c6480000/0xcbad34b281571ead lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281571eb4 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710956.169728:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790710957.191285:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790710958.215251:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790710959.239710:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790710959.277882:0:15514:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg646-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:3.0:1790710959.367742:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790710959.367750:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790710959.367753:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790710959.367757:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1790710959.368036:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c75dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877696177073792:0@lo:400:kworker.0 00000100:00100000:1.0:1790710959.368104:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710959.368190:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790710959.368198:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c75df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1877696177073920:0@lo:400:kworker.0 00000100:00100000:1.0:1790710959.368225:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710959.368273:0:14466:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177073792 00000100:00100000:1.0:1790710959.368281:0:14466:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177073792 00000100:00100000:1.0:1790710959.368321:0:14466:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177073920 00000100:00100000:1.0:1790710959.368324:0:14466:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177073920 00000100:00100000:1.0:1790710959.368353:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790710959.368363:0:14466:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff87dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877696177073792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790710959.368419:0:14466:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff87dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877696177073792:12345-0@lo:400:kworker.0 Request processed in 57us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710959.368426:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790710959.368445:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790710959.368460:0:14466:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff87f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877696177073920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790710959.368497:0:14466:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff87f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877696177073920:12345-0@lo:400:kworker.0 Request processed in 39us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710959.368504:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1790710959.368543:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1790710959.368574:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c51c75df800 x1877696177073920/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790710975 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790710959.368602:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c75df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1877696177073920:0@lo:400:kworker.0 00010000:00080000:1.0:1790710959.368616:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c51c75dc000 x1877696177073792/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790710975 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790710959.368624:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c75dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877696177073792:0@lo:400:kworker.0 00000100:00100000:0.0:1790710959.371360:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c75df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:3312:1877696177073664:0@lo:400:kworker.0 00000100:00100000:0.0:1790710959.371466:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710959.371679:0:14459:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177073664 00000100:00100000:1.0:1790710959.371688:0:14459:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177073664 00000100:00100000:1.0:1790710959.371728:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1790710959.371737:0:14459:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f470f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+16:3312:x1877696177073664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790710959.372053:0:14459:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f470f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+16:3312:x1877696177073664:12345-0@lo:400:kworker.0 Request processed in 316us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710959.372061:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1790710959.372112:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c75df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:3312:1877696177073664:0@lo:400:kworker.0 00010000:00010000:0.0:1790710960.269540:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790710961.297909:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790710962.311994:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790710963.336810:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790710964.362371:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790710964.487526:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790710964.487534:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790710964.487537:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790710964.487540:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1790710964.487843:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c75dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:3311:1877696177074048:0@lo:400:kworker.0 00000100:00100000:1.0:1790710964.487912:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710964.487971:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790710964.487978:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c75df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1877696177074176:0@lo:400:kworker.0 00000100:00100000:1.0:1790710964.488033:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710964.488069:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c75dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1877696177074304:0@lo:400:kworker.0 00000100:00100000:1.0:1790710964.488096:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710964.488160:0:14466:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177074176 00000100:00100000:1.0:1790710964.488168:0:14466:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177074176 00000100:00100000:1.0:1790710964.488210:0:14466:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177074304 00000100:00100000:1.0:1790710964.488213:0:14466:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177074304 00000100:00100000:1.0:1790710964.488238:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790710964.488247:0:14466:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff87e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1877696177074176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790710964.488301:0:14466:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff87e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1877696177074176:12345-0@lo:400:kworker.0 Request processed in 54us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710964.488308:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790710964.488324:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790710964.488330:0:14466:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff87c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877696177074304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790710964.488364:0:14466:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff87c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877696177074304:12345-0@lo:400:kworker.0 Request processed in 34us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710964.488370:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1790710964.488390:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1790710964.488413:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c51c75dc000 x1877696177074304/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790710980 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790710964.488426:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c75dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1877696177074304:0@lo:400:kworker.0 00010000:00080000:1.0:1790710964.488451:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c51c75df480 x1877696177074176/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790710980 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790710964.488459:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c75df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1877696177074176:0@lo:400:kworker.0 00000100:00100000:2.0:1790710964.489676:0:14458:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177074048 00000100:00100000:2.0:1790710964.489686:0:14458:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177074048 00000100:00100000:2.0:1790710964.489737:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1790710964.489745:0:14458:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f470d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+16:3311:x1877696177074048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790710964.489809:0:14458:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f470d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+16:3311:x1877696177074048:12345-0@lo:400:kworker.0 Request processed in 64us (1896us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710964.489815:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1790710964.489886:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c75dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:3311:1877696177074048:0@lo:400:kworker.0 00010000:00010000:1.0:1790710965.383719:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1790710965.659700:0:15865:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1790710965.659781:0:15865:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1790710965.659941:0:15865:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c51d02e9000 00000020:01000004:2.0:1790710965.659957:0:15865:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1790710965.659971:0:15865:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1790710965.659984:0:15865:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9c51ff4acd40) 00000020:00000080:2.0:1790710965.659998:0:15865:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1790710965.690921:0:15865:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1790710965.691370:0:15865:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1790710965.692213:0:15865:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1790710965.692458:0:15865:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1790710965.692681:0:15865:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1790710965.693063:0:15865:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 499: rc = 0 00100000:10000000:3.0:1790710965.693202:0:15865:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 499: rc = 0 00100000:10000000:3.0:1790710965.694948:0:15865:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 499: rc = 0 00100000:10000000:3.0:1790710965.695878:0:15865:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 641: rc = 0 00100000:10000000:3.0:1790710965.698495:0:15865:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 641: rc = 0 00100000:10000000:3.0:1790710965.698938:0:15865:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 641: rc = 0 00100000:10000000:3.0:1790710965.699226:0:15865:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 641: rc = 0 00100000:10000000:3.0:1790710965.699499:0:15865:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 641: rc = 0 00100000:10000000:3.0:1790710965.699779:0:15865:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 641: rc = 0 00000020:00000080:3.0:1790710965.700360:0:15865:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1790710965.700372:0:15865:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1790710965.700382:0:15865:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xcbad34b281571ec2 00000020:01000004:3.0:1790710965.700390:0:15865:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1790710965.700410:0:15865:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.146@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1790710965.700413:0:15865:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.146@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1790710965.700419:0:15865:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1790710965.700438:0:15865:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1790710965.700442:0:15865:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.146@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:00080000:2.0:1790710965.706418:0:14496:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:01000000:3.0:1790710965.716471:0:15865:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.146@tcp ctxt 0 is initialized 00000020:01000004:3.0:1790710965.716511:0:15865:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.146@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1790710965.716516:0:15865:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1790710965.716518:0:15865:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790710965.716519:0:15865:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790710965.716520:0:15865:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790710965.716522:0:15865:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790710965.716523:0:15865:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790710965.716525:0:15865:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790710965.716527:0:15865:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790710965.716528:0:15865:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790710965.716532:0:15865:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1790710965.716534:0:15865:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790710965.716536:0:15865:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790710965.716537:0:15865:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790710965.716538:0:15865:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790710965.716539:0:15865:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790710965.716540:0:15865:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790710965.716541:0:15865:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790710965.716542:0:15865:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790710965.716543:0:15865:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790710965.716569:0:15865:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1790710965.716595:0:15865:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c75df800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:15865:1877696177074432:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1790710965.717291:0:15865:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710965.717462:0:15865:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51d90c49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790710965.717549:0:14457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177074432 00000100:00100000:2.0:1790710965.717557:0:14457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177074432 00000100:00100000:2.0:1790710965.717654:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1790710965.717663:0:14457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f470d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+16:15865:x1877696177074432:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1790710965.717694:0:14457:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1790710965.717697:0:14457:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1790710965.717713:0:14457:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1790710965.722798:0:14457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f470d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+16:15865:x1877696177074432:12345-0@lo:253:mount.lustre.0 Request processed in 5128us (5500us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710965.722813:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1790710965.722933:0:15865:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c75df800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:15865:1877696177074432:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1790710965.722947:0:15865:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1790710965.722951:0:15865:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790710965.722952:0:15865:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790710965.722954:0:15865:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790710965.722969:0:15865:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790710965.722970:0:15865:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790710965.722972:0:15865:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790710965.722973:0:15865:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790710965.722975:0:15865:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790710965.722976:0:15865:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1790710965.722994:0:15865:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c51d02e9000 from lustre-OST0001 10000000:01000000:0.0:1790710965.723017:0:15865:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1790710965.723020:0:15865:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1790710965.723027:0:15865:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9c51fa0e0000 local copy 00010000:00010000:0.0:1790710965.723038:0:15865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c243b800/0xcbad34b281571d33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281571d3a expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710965.723293:0:15865:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c50c35b2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:15865:1877696177074560:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790710965.723330:0:15865:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710965.723366:0:15865:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c5f57f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790710965.723592:0:14459:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177074560 00000100:00100000:2.0:1790710965.723599:0:14459:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177074560 00000100:00100000:2.0:1790710965.723656:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1790710965.723666:0:14459:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f470e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+16:15865:x1877696177074560:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790710965.723877:0:14459:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f470e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+16:15865:x1877696177074560:12345-0@lo:501:mount.lustre.0 Request processed in 211us (545us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790710965.723885:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1790710965.723984:0:15865:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c50c35b2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:15865:1877696177074560:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1790710965.724003:0:15865:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.146@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1790710965.724203:0:15865:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.146@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1790710965.724212:0:15865:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c243b800/0xcbad34b281571d33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281571d3a expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710965.724222:0:15865:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.146@tcp lock: ffff9c51c243b800/0xcbad34b281571d33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281571d3a expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790710965.724244:0:15865:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c51d02e9000 10000000:01000000:1.0:1790710965.724250:0:15865:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1790710965.724255:0:15865:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1790710965.724257:0:15865:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790710965.724262:0:15865:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1790710965.724265:0:15865:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1790710965.724288:0:15865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c6481400/0xcbad34b281571ec9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710965.724296:0:15865:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.146@tcp lock: ffff9c51c6481400/0xcbad34b281571ec9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710965.724306:0:15865:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.146@tcp lock: ffff9c51c6481400/0xcbad34b281571ec9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710965.724322:0:15865:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51ff87ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:15865:1877696177074688:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790710965.724354:0:15865:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710965.724375:0:15865:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f9f1c300 going to sleep for 11 seconds 00000100:00100000:2.0:1790710965.724516:0:14457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177074688 00000100:00100000:2.0:1790710965.724521:0:14457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177074688 00000100:00100000:2.0:1790710965.724556:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1790710965.724572:0:14457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f470c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+16:15865:x1877696177074688:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790710965.724583:0:14457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790710965.724595:0:14457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c51f43f9c00/0xcbad34b281571ed0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbad34b281571ec9 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710965.724613:0:14457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c51f43f9c00/0xcbad34b281571ed0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbad34b281571ec9 expref: 17 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710965.724625:0:14457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c51f43f9c00/0xcbad34b281571ed0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281571ec9 expref: 17 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710965.724633:0:14457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51f43f9c00, rc 0) 00000100:00100000:2.0:1790710965.724679:0:14457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f470c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+17:15865:x1877696177074688:12345-0@lo:101:mount.lustre.0 Request processed in 108us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710965.724686:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1790710965.724889:0:15865:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51ff87ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:15865:1877696177074688:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790710965.724903:0:15865:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.146@tcp lock: ffff9c51c6481400/0xcbad34b281571ec9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281571ed0 expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710965.724917:0:15865:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.146@tcp lock: ffff9c51c6481400/0xcbad34b281571ec9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbad34b281571ed0 expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790710965.725646:0:15865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1790710965.727572:0:15865:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790710965.727918:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1790710965.727964:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1790710965.728000:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1790710965.728050:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1790710965.728086:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1790710965.728119:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1790710965.728324:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1790710965.728332:0:15865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1790710965.728425:0:15865:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51ff87ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:15865:1877696177074816:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790710965.728563:0:15865:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710965.728656:0:15865:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f9f1ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1790710965.728768:0:14457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177074816 00000100:00100000:2.0:1790710965.728776:0:14457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177074816 00000100:00100000:2.0:1790710965.728864:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1790710965.728874:0:14457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f470c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+17:15865:x1877696177074816:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790710965.729286:0:14457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f470c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+17:15865:x1877696177074816:12345-0@lo:501:mount.lustre.0 Request processed in 412us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710965.729296:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1790710965.729432:0:15865:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51ff87ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:15865:1877696177074816:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790710965.729471:0:15865:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c75dd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:15865:1877696177074944:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790710965.729623:0:15865:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710965.729862:0:15865:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c8189600 going to sleep for 11 seconds 00000100:00100000:1.0:1790710965.729906:0:14459:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177074944 00000100:00100000:1.0:1790710965.729911:0:14459:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177074944 00000100:00100000:0.0:1790710965.729955:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1790710965.729964:0:14458:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f470e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+17:15865:x1877696177074944:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790710965.730371:0:14458:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f470e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+17:15865:x1877696177074944:12345-0@lo:503:mount.lustre.0 Request processed in 408us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710965.730378:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1790710965.730833:0:15865:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c75dd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:15865:1877696177074944:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1790710965.732359:0:15865:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790710965.732444:0:15865:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d63480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:15865:1877696177075072:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790710965.732626:0:15865:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710965.732724:0:15865:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f979a600 going to sleep for 11 seconds 00000100:00100000:0.0:1790710965.732827:0:14457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177075072 00000100:00100000:0.0:1790710965.732835:0:14457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177075072 00000100:00100000:0.0:1790710965.732914:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1790710965.732924:0:14457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f470f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+17:15865:x1877696177075072:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790710965.733177:0:14457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f470f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+17:15865:x1877696177075072:12345-0@lo:502:mount.lustre.0 Request processed in 254us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710965.733185:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1790710965.733271:0:15865:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d63480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:15865:1877696177075072:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790710965.733567:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1790710965.733620:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1790710965.733674:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1790710965.733737:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1790710965.733774:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1790710965.733807:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1790710965.733857:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1790710965.733896:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1790710965.733947:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1790710965.733979:0:15865:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d63480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:15865:1877696177075200:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790710965.734025:0:15865:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710965.734367:0:15865:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f979a600 going to sleep for 11 seconds 00000100:00100000:1.0:1790710965.734445:0:14459:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177075200 00000100:00100000:1.0:1790710965.734452:0:14459:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177075200 00000100:00100000:1.0:1790710965.734546:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1790710965.734556:0:14459:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f470e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+17:15865:x1877696177075200:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790710965.734923:0:14459:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f470e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+17:15865:x1877696177075200:12345-0@lo:502:mount.lustre.0 Request processed in 367us (895us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710965.734931:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1790710965.735003:0:15865:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d63480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:15865:1877696177075200:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790710965.735090:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1790710965.735102:0:15865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:1.0:1790710965.736584:0:15866:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1790710965.736594:0:15866:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1790710965.736602:0:15866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790710965.736612:0:15866:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1790710965.736620:0:15866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790710965.736634:0:15866:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9c51fa3d3380) 00000020:00000080:1.0:1790710965.736667:0:15866:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:1.0:1790710965.736674:0:15866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1790710965.736811:0:15866:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c51d02e9000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1790710965.736820:0:15866:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1790710965.736828:0:15866:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xcbad34b281571ede 00010000:00010000:1.0:1790710965.740694:0:15866:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:1.0:1790710965.741239:0:15866:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:1.0:1790710965.743402:0:15866:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1790710965.745352:0:15866:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1790710965.745364:0:15866:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790710965.745372:0:15866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790710965.745374:0:15866:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1790710965.745377:0:15866:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790710965.745382:0:15866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790710965.745383:0:15866:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1790710965.745386:0:15866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1790710965.745388:0:15866:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1790710965.745390:0:15866:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790710965.745392:0:15866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790710965.745393:0:15866:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:1.0:1790710965.745395:0:15866:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790710965.745397:0:15866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790710965.745398:0:15866:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1790710965.745401:0:15866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1790710965.745464:0:15866:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790710965.745468:0:15866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790710965.745469:0:15866:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1790710965.745472:0:15866:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1790710965.745714:0:15865:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1790710965.745740:0:15865:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.146@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1790710965.745763:0:15865:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c6481400/0xcbad34b281571ec9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281571ed0 expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710965.745775:0:15865:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.146@tcp lock: ffff9c51c6481400/0xcbad34b281571ec9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281571ed0 expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790710965.745783:0:15865:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c51d02e9000 from 1 10000000:01000000:2.0:1790710965.745786:0:15865:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790710965.745820:0:15865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51f43f9600/0xcbad34b281571ee5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710965.745828:0:15865:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.146@tcp lock: ffff9c51f43f9600/0xcbad34b281571ee5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710965.745848:0:15865:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.146@tcp lock: ffff9c51f43f9600/0xcbad34b281571ee5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710965.745873:0:15865:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d63480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:15865:1877696177075328:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790710965.745939:0:15865:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710965.745988:0:15865:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51ee771d80 going to sleep for 11 seconds 00000100:00100000:3.0:1790710965.746149:0:14457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177075328 00000100:00100000:3.0:1790710965.746156:0:14457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177075328 00000100:00100000:3.0:1790710965.746205:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1790710965.746213:0:14457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51fba9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+17:15865:x1877696177075328:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790710965.746227:0:14457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790710965.746240:0:14457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c51c8046200/0xcbad34b281571eec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbad34b281571ee5 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710965.746263:0:14457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c51c8046200/0xcbad34b281571eec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbad34b281571ee5 expref: 18 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710965.746273:0:14457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c51c8046200/0xcbad34b281571eec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281571ee5 expref: 18 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710965.746280:0:14457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c8046200, rc 0) 00000100:00100000:3.0:1790710965.746325:0:14457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51fba9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+18:15865:x1877696177075328:12345-0@lo:101:mount.lustre.0 Request processed in 112us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710965.746332:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1790710965.746378:0:15865:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d63480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:15865:1877696177075328:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790710965.746399:0:15865:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.146@tcp lock: ffff9c51f43f9600/0xcbad34b281571ee5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281571eec expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710965.746408:0:15865:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.146@tcp lock: ffff9c51f43f9600/0xcbad34b281571ee5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbad34b281571eec expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790710965.746908:0:15865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1790710965.747341:0:15865:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790710965.747568:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1790710965.747613:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1790710965.748028:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1790710965.748038:0:15865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1790710965.748105:0:15865:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c75dd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:15865:1877696177075456:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790710965.748199:0:15865:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710965.748231:0:15865:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c8189d80 going to sleep for 11 seconds 00000100:00100000:1.0:1790710965.748332:0:14459:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177075456 00000100:00100000:1.0:1790710965.748338:0:14459:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177075456 00000100:00100000:1.0:1790710965.748374:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1790710965.748391:0:14459:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51fba98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+18:15865:x1877696177075456:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790710965.748615:0:14459:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51fba98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+18:15865:x1877696177075456:12345-0@lo:501:mount.lustre.0 Request processed in 224us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710965.748623:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1790710965.748922:0:15865:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c75dd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:15865:1877696177075456:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790710965.748958:0:15865:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c75dd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:15865:1877696177075584:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790710965.748996:0:15865:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710965.749064:0:15865:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c8189d80 going to sleep for 11 seconds 00000100:00100000:2.0:1790710965.750621:0:14458:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177075584 00000100:00100000:2.0:1790710965.750632:0:14458:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177075584 00000100:00100000:2.0:1790710965.750688:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1790710965.750697:0:14458:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51fba99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+18:15865:x1877696177075584:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790710965.752500:0:14458:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51fba99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+18:15865:x1877696177075584:12345-0@lo:503:mount.lustre.0 Request processed in 1788us (3487us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710965.752511:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1790710965.752695:0:15865:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c75dd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:15865:1877696177075584:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1790710965.753242:0:15865:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790710965.753315:0:15865:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51ff87f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:15865:1877696177075712:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790710965.753365:0:15865:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710965.753392:0:15865:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51d90cf6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790710965.753914:0:14459:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177075712 00000100:00100000:2.0:1790710965.753922:0:14459:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177075712 00000100:00100000:2.0:1790710965.753961:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1790710965.753969:0:14459:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51fba99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+18:15865:x1877696177075712:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790710965.754192:0:14459:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51fba99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+18:15865:x1877696177075712:12345-0@lo:502:mount.lustre.0 Request processed in 223us (826us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710965.754200:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1790710965.754869:0:15865:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51ff87f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:15865:1877696177075712:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790710965.755117:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1790710965.755188:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1790710965.755240:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1790710965.755280:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1790710965.755318:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1790710965.755367:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1790710965.755404:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1790710965.755439:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1790710965.755473:0:15865:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51ff87f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:15865:1877696177075840:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790710965.755542:0:15865:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710965.755578:0:15865:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51d90cf6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790710965.755599:0:14459:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177075840 00000100:00100000:1.0:1790710965.755604:0:14459:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177075840 00000100:00100000:1.0:1790710965.755635:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1790710965.755654:0:14459:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4ec4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+18:15865:x1877696177075840:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790710965.755936:0:14459:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4ec4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+18:15865:x1877696177075840:12345-0@lo:502:mount.lustre.0 Request processed in 283us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710965.755949:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1790710965.755994:0:15865:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51ff87f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:15865:1877696177075840:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790710965.756079:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1790710965.756090:0:15865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1790710965.760120:0:15870:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790710965.760245:0:15870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790710965.760248:0:15870:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1790710965.760257:0:15870:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c51d02e9000 00000020:00000080:2.0:1790710965.760259:0:15870:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790710965.760274:0:15870:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790710965.760286:0:15870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790710965.760287:0:15870:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1790710965.760291:0:15870:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790710965.760294:0:15870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790710965.760295:0:15870:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1790710965.760299:0:15870:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c51d02e9000 00000020:00000080:2.0:1790710965.760301:0:15870:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790710965.760341:0:15870:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790710965.760344:0:15870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790710965.760345:0:15870:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1790710965.760347:0:15870:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790710965.760349:0:15870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790710965.760350:0:15870:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1790710965.760353:0:15870:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c51d02e9000 00000020:00000080:2.0:1790710965.760355:0:15870:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790710965.760392:0:15870:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790710965.760396:0:15870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790710965.760397:0:15870:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1790710965.760401:0:15870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1790710965.763618:0:15865:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1790710965.763675:0:15865:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790710965.763696:0:15865:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51f43f9600/0xcbad34b281571ee5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281571eec expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710965.763843:0:15865:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.146@tcp lock: ffff9c51f43f9600/0xcbad34b281571ee5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281571eec expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790710965.763910:0:15865:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1790710965.763914:0:15865:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c51d02e9000 10000000:01000000:1.0:1790710965.763917:0:15865:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c51d02e9000 10000000:01000000:1.0:1790710965.763921:0:15865:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790710965.763926:0:15865:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c51d02e9000 from 1 10000000:01000000:1.0:1790710965.763928:0:15865:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1790710965.763976:0:15865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c6481e00/0xcbad34b281571ef3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710965.763984:0:15865:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.146@tcp lock: ffff9c51c6481e00/0xcbad34b281571ef3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710965.763995:0:15865:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.146@tcp lock: ffff9c51c6481e00/0xcbad34b281571ef3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710965.764020:0:15865:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51ff87f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:15865:1877696177075968:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790710965.764095:0:15865:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710965.764162:0:15865:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51d90cf000 going to sleep for 11 seconds 00000100:00100000:3.0:1790710965.764225:0:14459:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177075968 00000100:00100000:3.0:1790710965.764233:0:14459:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177075968 00000100:00100000:3.0:1790710965.764278:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1790710965.764287:0:14459:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f3d54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+18:15865:x1877696177075968:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790710965.764301:0:14459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790710965.764314:0:14459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c51c8047200/0xcbad34b281571efa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbad34b281571ef3 expref: -99 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710965.764338:0:14459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c51c8047200/0xcbad34b281571efa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbad34b281571ef3 expref: 19 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710965.764357:0:14459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c51c8047200/0xcbad34b281571efa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281571ef3 expref: 19 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710965.764366:0:14459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c8047200, rc 0) 00000100:00100000:3.0:1790710965.764409:0:14459:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f3d54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+19:15865:x1877696177075968:12345-0@lo:101:mount.lustre.0 Request processed in 123us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710965.764416:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1790710965.764565:0:15865:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51ff87f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:15865:1877696177075968:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790710965.764580:0:15865:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.146@tcp lock: ffff9c51c6481e00/0xcbad34b281571ef3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281571efa expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710965.764589:0:15865:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.146@tcp lock: ffff9c51c6481e00/0xcbad34b281571ef3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbad34b281571efa expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790710965.766283:0:15865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1790710965.767393:0:15865:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790710965.769203:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1790710965.769268:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1790710965.769307:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1790710965.769356:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1790710965.769393:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1790710965.769444:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1790710965.769483:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1790710965.769607:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1790710965.769672:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1790710965.769725:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1790710965.769765:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1790710965.769819:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1790710965.769854:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1790710965.769884:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1790710965.774598:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1790710965.774763:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1790710965.774826:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1790710965.774905:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1790710965.774940:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1790710965.774975:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1790710965.775038:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1790710965.775076:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1790710965.775111:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1790710965.775201:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1790710965.775245:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1790710965.775282:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1790710965.775336:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1790710965.775375:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1790710965.775414:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1790710965.775467:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:1.0:1790710965.776253:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:1.0:1790710965.776302:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:1.0:1790710965.776357:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:1.0:1790710965.776411:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:1.0:1790710965.776445:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:1.0:1790710965.778688:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:1.0:1790710965.778875:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:1.0:1790710965.778971:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:1.0:1790710965.778978:0:15865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1790710965.779076:0:15865:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51ff87f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:15865:1877696177076096:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790710965.779160:0:15865:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710965.779206:0:15865:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51d90cf000 going to sleep for 11 seconds 00000100:00100000:2.0:1790710965.779613:0:14457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177076096 00000100:00100000:2.0:1790710965.779621:0:14457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177076096 00000100:00100000:2.0:1790710965.779679:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1790710965.779689:0:14457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f3d55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+19:15865:x1877696177076096:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790710965.779942:0:14457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f3d55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+19:15865:x1877696177076096:12345-0@lo:501:mount.lustre.0 Request processed in 254us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710965.779950:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1790710965.780113:0:15865:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51ff87f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:15865:1877696177076096:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790710965.780182:0:15865:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51ff87f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:15865:1877696177076224:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790710965.780224:0:15865:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710965.780249:0:15865:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51d90cf000 going to sleep for 11 seconds 00000100:00100000:2.0:1790710965.780628:0:14458:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177076224 00000100:00100000:2.0:1790710965.780634:0:14458:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177076224 00000100:00100000:2.0:1790710965.780676:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1790710965.780683:0:14458:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f3d57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+19:15865:x1877696177076224:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790710965.780939:0:14458:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f3d57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+19:15865:x1877696177076224:12345-0@lo:503:mount.lustre.0 Request processed in 255us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710965.780953:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1790710965.782635:0:15865:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51ff87f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:15865:1877696177076224:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1790710965.785837:0:15865:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790710965.785932:0:15865:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51ff87f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:15865:1877696177076352:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790710965.786029:0:15865:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710965.786077:0:15865:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c5f57a80 going to sleep for 11 seconds 00000100:00100000:2.0:1790710965.786220:0:14459:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177076352 00000100:00100000:2.0:1790710965.786228:0:14459:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177076352 00000100:00100000:2.0:1790710965.786282:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1790710965.786291:0:14459:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f3d54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+19:15865:x1877696177076352:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790710965.786543:0:14459:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f3d54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+19:15865:x1877696177076352:12345-0@lo:502:mount.lustre.0 Request processed in 253us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710965.786552:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1790710965.787033:0:15865:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51ff87f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:15865:1877696177076352:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790710965.787342:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1790710965.787394:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1790710965.787429:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1790710965.787478:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1790710965.789164:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1790710965.789252:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1790710965.789294:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1790710965.789350:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1790710965.789402:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1790710965.789439:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1790710965.789473:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1790710965.795045:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1790710965.795106:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1790710965.795164:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1790710965.795214:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1790710965.795252:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1790710965.795288:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1790710965.795337:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1790710965.795373:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1790710965.795405:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1790710965.795451:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1790710965.795482:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1790710965.795531:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1790710965.795604:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1790710965.795655:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1790710965.795694:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1790710965.796240:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1790710965.796280:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1790710965.796331:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1790710965.796384:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1790710965.796423:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1790710965.796459:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1790710965.796569:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1790710965.796647:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1790710965.796687:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1790710965.796819:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1790710965.796857:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1790710965.796892:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1790710965.796952:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1790710965.797007:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1790710965.797056:0:15865:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51ff87f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:15865:1877696177076480:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790710965.797165:0:15865:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710965.797214:0:15865:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51d90cf000 going to sleep for 11 seconds 00000100:00100000:3.0:1790710965.797558:0:14457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177076480 00000100:00100000:3.0:1790710965.797568:0:14457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177076480 00000100:00100000:3.0:1790710965.797611:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1790710965.797620:0:14457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f3d57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+19:15865:x1877696177076480:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790710965.797871:0:14457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f3d57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+19:15865:x1877696177076480:12345-0@lo:502:mount.lustre.0 Request processed in 251us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710965.797880:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1790710965.799684:0:15865:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51ff87f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:15865:1877696177076480:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790710965.799887:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1790710965.799902:0:15865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1790710965.803453:0:15875:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1790710965.803472:0:15875:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9c51d02d19c0) 00000020:00000080:2.0:1790710965.803525:0:15875:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:2.0:1790710965.803598:0:15875:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c51d02e9000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1790710965.803602:0:15875:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c51d02e9000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1790710965.803605:0:15875:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c51d02e9000 3 00010000:00080000:2.0:1790710965.803635:0:15875:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c50c2743800@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.146@tcp at head 00010000:00010000:2.0:1790710965.807700:0:15875:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:2.0:1790710965.808533:0:15875:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1790710965.808571:0:15875:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1790710965.808582:0:15875:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xcbad34b281571f08 00000100:00080000:2.0:1790710965.808592:0:15875:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790710965.808605:0:15875:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c50c2743800 using connection 192.168.206.146@tcp/0@lo 00000100:00100000:2.0:1790710965.808650:0:15875:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c51f4d60e00 x1877696177076608/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790710965.808689:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3308:1877696177076608:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1790710965.808952:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1790710965.810015:0:15875:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1790710965.810050:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790710965.810054:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790710965.810057:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790710965.810059:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1790710965.810121:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1877696177076864:0@lo:400:kworker.0 00000100:00100000:2.0:1790710965.810191:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710965.814606:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790710965.814633:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877696177076736:0@lo:400:kworker.0 00000100:00100000:0.0:1790710965.817736:0:14466:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177076608 00000100:00100000:0.0:1790710965.817752:0:14466:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177076608 00000100:00100000:0.0:1790710965.817793:0:14466:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177076864 00000100:00100000:0.0:1790710965.817797:0:14466:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177076864 00000100:00100000:0.0:1790710965.817824:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790710965.817832:0:14466:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1877696177076864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790710965.817915:0:14466:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1877696177076864:12345-0@lo:400:kworker.0 Request processed in 83us (7723us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710965.817923:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790710965.817944:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790710965.817949:0:14466:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3308:x1877696177076608:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1790710965.817971:0:14466:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 443 last 0 00000020:00000080:0.0:1790710965.818011:0:14466:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xcbad34b281571f0f 00000004:00100000:0.0:1790710965.818026:0:14466:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1790710965.818059:0:14466:0:(import.c:65:import_set_state_nolock()) ffff9c51f3c37800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790710965.818102:0:14466:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1877696177076608:12345-0@lo:38:llog_process_th.0 Request processed in 152us (9150us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710965.818110:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1790710965.818176:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c51f4d60e00 x1877696177076608/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790710975 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790710965.818187:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790710965.818194:0:3308:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1790710965.818201:0:3308:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1790710965.818206:0:3308:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1790710965.818208:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9c50c2743800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1790710965.818214:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3308:1877696177076608:0@lo:38:llog_process_th.0 00010000:00080000:0.0:1790710965.818243:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c51f4d62680 x1877696177076864/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790710981 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790710965.818267:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1877696177076864:0@lo:400:kworker.0 00000100:00100000:0.0:1790710965.820609:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710965.820679:0:14466:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177076736 00000100:00100000:0.0:1790710965.820688:0:14466:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177076736 00000100:00100000:0.0:1790710965.820749:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790710965.820758:0:14466:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c50c35b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877696177076736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790710965.820837:0:14466:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c50c35b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877696177076736:12345-0@lo:400:kworker.0 Request processed in 79us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710965.820845:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1790710965.820890:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c51f4d60380 x1877696177076736/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790710981 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790710965.820905:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877696177076736:0@lo:400:kworker.0 00000040:00080000:3.0:1790710965.822549:0:15875:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1790710965.823012:0:15865:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1790710965.823042:0:15865:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790710965.823067:0:15865:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c6481e00/0xcbad34b281571ef3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281571efa expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710965.823081:0:15865:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.146@tcp lock: ffff9c51c6481e00/0xcbad34b281571ef3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281571efa expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1790710965.823168:0:15865:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1790710965.823171:0:15865:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790710965.823172:0:15865:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790710965.823174:0:15865:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790710965.823175:0:15865:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790710965.823176:0:15865:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790710965.823178:0:15865:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790710965.823180:0:15865:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790710965.823187:0:15865:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790710965.823191:0:15865:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1790710965.823194:0:15865:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790710965.823195:0:15865:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790710965.823196:0:15865:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790710965.823197:0:15865:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790710965.823198:0:15865:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790710965.823199:0:15865:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790710965.823200:0:15865:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790710965.823201:0:15865:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790710965.823202:0:15865:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790710965.823228:0:15865:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1790710965.823250:0:15865:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c50c35b3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:15865:1877696177076992:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1790710965.823336:0:15865:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710965.823372:0:15865:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51d8a96b40 going to sleep for 11 seconds 00000100:00100000:2.0:1790710965.823442:0:14458:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177076992 00000100:00100000:2.0:1790710965.823450:0:14458:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177076992 00000100:00100000:2.0:1790710965.823505:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1790710965.823515:0:14458:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f3d55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+19:15865:x1877696177076992:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1790710965.823549:0:14458:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1790710965.823564:0:14458:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1790710965.850385:0:14458:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1790710965.850399:0:14458:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1790710965.850430:0:14480:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1790710965.850434:0:14480:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1790710965.850456:0:14480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c51c8046800/0xcbad34b281571f16 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710965.850478:0:14480:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c51f43f8200/0xcbad34b281571eb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281571ead expref: 19 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710965.850557:0:14480:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c51c8046800/0xcbad34b281571f16 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710965.850614:0:14480:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c51f43f8200/0xcbad34b281571eb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbad34b281571ead expref: 19 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710965.850628:0:14480:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c51f43f8200/0xcbad34b281571eb4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbad34b281571ead expref: 19 pid: 14457 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710965.850655:0:14480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c75dd500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14480:1877696177077120:0@lo:104: 00000100:00100000:3.0:1790710965.850938:0:14480:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710965.850978:0:14480:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c2bb6240 going to sleep for 11 seconds 00000100:00100000:3.0:1790710965.851006:0:14447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177077120 00000100:00100000:3.0:1790710965.851013:0:14447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177077120 00000100:00100000:3.0:1790710965.851050:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790710965.851058:0:14447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c75dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+3:14480:x1877696177077120:12345-0@lo:104: 00010000:00010000:3.0:1790710965.851071:0:14447:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.146@tcp lock: ffff9c51c6480000/0xcbad34b281571ead lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbad34b281571eb4 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710965.851119:0:14447:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790710965.851157:0:14447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c75dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+3:14480:x1877696177077120:12345-0@lo:104: Request processed in 68us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710965.851165:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1790710965.851461:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790710965.851468:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.146@tcp lock: ffff9c51c6480000/0xcbad34b281571ead lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbad34b281571eb4 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710965.851475:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c6480000 already unused, calling callback (ffffffffc1cdfc20) 10000000:00010000:3.0:1790710965.851479:0:14452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.146@tcp lock: ffff9c51c6480000/0xcbad34b281571ead lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbad34b281571eb4 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710965.851623:0:14452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.146@tcp lock: ffff9c51c6480000/0xcbad34b281571ead lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbad34b281571eb4 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790710965.851631:0:14452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.146@tcp lock: ffff9c51c6480000/0xcbad34b281571ead lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbad34b281571eb4 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790710965.851648:0:14452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1790710965.851683:0:14452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.146@tcp lock: ffff9c51c6480000/0xcbad34b281571ead lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281571eb4 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710965.851690:0:14452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1790710965.851828:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c75dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:3312:1877696177077248:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790710965.851865:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710965.851934:0:14451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177077248 00000100:00100000:1.0:1790710965.851939:0:14451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177077248 00010000:00010000:1.0:1790710965.851960:0:14451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c51f43f8200/0xcbad34b281571eb4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbad34b281571ead expref: 20 pid: 14457 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710965.851989:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790710965.851996:0:14451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c50c35b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+20:3312:x1877696177077248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790710965.852006:0:14451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790710965.852011:0:14451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c51f43f8200/0xcbad34b281571eb4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbad34b281571ead expref: 20 pid: 14457 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710965.852028:0:14451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c51f43f8200/0xcbad34b281571eb4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbad34b281571ead expref: 20 pid: 14457 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710965.852044:0:14451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c51c8046800/0xcbad34b281571f16 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710965.852052:0:14451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c51c8046800/0xcbad34b281571f16 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1790710965.852065:0:14451:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002809584s 00010000:00010000:1.0:1790710965.852069:0:14451:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c51c8046800/0xcbad34b281571f16 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710965.852076:0:14451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c51c8046800/0xcbad34b281571f16 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710965.852083:0:14451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c51c8046800/0xcbad34b281571f16 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710965.852089:0:14451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c51c8046800/0xcbad34b281571f16 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710965.852095:0:14451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c8046800 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:1.0:1790710965.852099:0:14451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c51c8046800/0xcbad34b281571f16 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710965.852106:0:14451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c51c8046800/0xcbad34b281571f16 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710965.852115:0:14451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c51c8046800/0xcbad34b281571f16 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710965.852153:0:14451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790710965.852268:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.146@tcp lock: ffff9c51c6480000/0xcbad34b281571ead lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281571eb4 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710965.852276:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.146@tcp lock: ffff9c51c6480000/0xcbad34b281571ead lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281571eb4 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710965.852291:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790710965.852293:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790710965.852295:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790710965.852329:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c51f43f8200/0xcbad34b281571eb4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbad34b281571ead expref: 20 pid: 14457 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710965.852338:0:14480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c75dd500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14480:1877696177077120:0@lo:104: 00010000:00010000:3.0:1790710965.852353:0:14480:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c51c8046800/0xcbad34b281571f16 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710965.852362:0:14480:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c51c8046800/0xcbad34b281571f16 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710965.852379:0:14480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c51c8046800/0xcbad34b281571f16 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710965.852385:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c51c8046800/0xcbad34b281571f16 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710965.855359:0:14451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c50c35b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+19:3312:x1877696177077248:12345-0@lo:103:ldlm_bl.0 Request processed in 3355us (3484us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710965.855375:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790710965.856208:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c75dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:3312:1877696177077248:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790710965.864812:0:14458:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f3d55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+18:15865:x1877696177076992:12345-0@lo:253:mount.lustre.0 Request processed in 41283us (41460us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710965.864829:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1790710965.864943:0:15865:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c50c35b3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:15865:1877696177076992:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1790710965.864959:0:15865:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1790710965.864963:0:15865:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790710965.864964:0:15865:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790710965.864965:0:15865:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790710965.864966:0:15865:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790710965.864968:0:15865:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790710965.864969:0:15865:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790710965.864971:0:15865:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790710965.864972:0:15865:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790710965.864974:0:15865:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1790710965.864990:0:15865:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1790710965.870419:0:15865:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1790710965.870688:0:15865:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1790710965.871117:0:15865:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1790710965.871436:0:15865:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1790710965.871680:0:15865:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1790710965.872378:0:15865:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1790710965.874066:0:15865:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1790710965.933060:0:15865:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1790710965.933070:0:15865:0:(lfsck_lib.c:3084:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1790710965.933108:0:15865:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1790710965.933197:0:15865:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.146@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1790710965.933213:0:15865:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1790710965.933240:0:15865:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1790710966.408120:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1790710967.175257:0:14461:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1790710967.175267:0:14461:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c51f49a9800 from 8 10000000:01000000:1.0:1790710967.175271:0:14461:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790710967.175323:0:14461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c6481600/0xcbad34b281571f1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710967.175335:0:14461:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.146@tcp lock: ffff9c51c6481600/0xcbad34b281571f1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710967.175346:0:14461:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.146@tcp lock: ffff9c51c6481600/0xcbad34b281571f1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710967.175372:0:14461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51ff87f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:14461:1877696177077376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790710967.175443:0:14461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710967.175514:0:14461:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f979a540 going to sleep for 11 seconds 00000100:00100000:2.0:1790710967.175790:0:14459:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177077376 00000100:00100000:2.0:1790710967.175799:0:14459:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177077376 00000100:00100000:2.0:1790710967.175859:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1790710967.175869:0:14459:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f3d55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+18:14461:x1877696177077376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790710967.175885:0:14459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790710967.175913:0:14459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c51f43f9000/0xcbad34b281571f24 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbad34b281571f1d expref: -99 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710967.175946:0:14459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c51f43f9000/0xcbad34b281571f24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbad34b281571f1d expref: 19 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710967.175957:0:14459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c51f43f9000/0xcbad34b281571f24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281571f1d expref: 19 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710967.175966:0:14459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51f43f9000, rc 0) 00000100:00100000:2.0:1790710967.176023:0:14459:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f3d55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+19:14461:x1877696177077376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710967.176030:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1790710967.176082:0:14461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51ff87f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:14461:1877696177077376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790710967.176096:0:14461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.146@tcp lock: ffff9c51c6481600/0xcbad34b281571f1d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281571f24 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710967.176118:0:14461:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.146@tcp lock: ffff9c51c6481600/0xcbad34b281571f1d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbad34b281571f24 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710967.176420:0:14461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d63100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:14461:1877696177077504:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1790710967.176464:0:14461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710967.176489:0:14461:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c5d56180 going to sleep for 11 seconds 00000100:00100000:0.0:1790710967.176561:0:14457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177077504 00000100:00100000:0.0:1790710967.176567:0:14457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177077504 00000100:00100000:0.0:1790710967.176603:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1790710967.176620:0:14457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f3d56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+19:14461:x1877696177077504:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1790710967.176645:0:14457:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1790710967.176662:0:14457:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1790710967.176666:0:14457:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1790710967.176753:0:14457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f3d56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+19:14461:x1877696177077504:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 134us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710967.176760:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1790710967.176792:0:14461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d63100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:14461:1877696177077504:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1790710967.176859:0:14461:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.146@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1790710967.176866:0:14461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c6481600/0xcbad34b281571f1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281571f24 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710967.176876:0:14461:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.146@tcp lock: ffff9c51c6481600/0xcbad34b281571f1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281571f24 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710967.431432:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790710968.461527:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790710968.904019:0:3308:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790710953/real 1790710953] req@ffff9c51c75de680 x1877696177070464/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790710968 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790710968.904046:0:3308:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c51c75de680 x1877696177070464/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790710968 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790710968.904056:0:3308:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790710953/real 1790710953] req@ffff9c50c35b1f80 x1877696177070208/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790710968 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790710968.904066:0:3308:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c50c35b1f80 x1877696177070208/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790710968 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1790710968.904082:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9c51f444d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790710968.904111:0:3308:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1790710968.904124:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c75de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1877696177070464:0@lo:8:kworker.0 00000100:00080000:0.0:1790710968.904148:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9c51d02d9800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790710968.907835:0:3308:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1790710968.907846:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c50c35b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1877696177070208:0@lo:8:kworker.0 00000100:00080000:2.0:1790710968.908071:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790710968.908076:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1790710968.908079:0:38:0:(import.c:65:import_set_state_nolock()) ffff9c51f444d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790710968.908084:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 431 00000100:00080000:2.0:1790710968.908089:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1790710968.908100:0:38:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c51f444d800 using connection 192.168.206.146@tcp/0@lo 00000100:00100000:2.0:1790710968.908122:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c51f4d61f80 x1877696177077760/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790710968.908163:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790710968.908166:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1790710968.908167:0:38:0:(import.c:65:import_set_state_nolock()) ffff9c51d02d9800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1790710968.908203:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:3309:1877696177077632:0@lo:400:kworker.0 00000100:00100000:0.0:1790710968.908266:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710968.908321:0:14457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177077632 00000100:00100000:0.0:1790710968.908328:0:14457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177077632 00000100:00100000:0.0:1790710968.908368:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1790710968.908376:0:14457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f3d54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+19:3309:x1877696177077632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790710968.908420:0:14457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f3d54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+19:3309:x1877696177077632:12345-0@lo:400:kworker.0 Request processed in 45us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710968.908426:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1790710968.908466:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:3309:1877696177077632:0@lo:400:kworker.0 00000100:00100000:0.0:1790710968.908493:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1877696177077760:0@lo:8:kworker.0 00000100:00100000:0.0:1790710968.908516:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710968.908560:0:15148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177077760 00000100:00100000:3.0:1790710968.908565:0:15148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177077760 00000100:00080000:2.0:1790710968.908573:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 431 00000100:00080000:2.0:1790710968.908576:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1790710968.908588:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c51d02d9800 using connection 192.168.206.146@tcp/0@lo 00000100:00100000:3.0:1790710968.908591:0:15148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790710968.908597:0:15148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c50c35b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3308:x1877696177077760:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1790710968.908601:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c51f4d61180 x1877696177077888/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00080000:3.0:1790710968.908619:0:15148:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 446 last 0 00000020:00000080:3.0:1790710968.908660:0:15148:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcbad34b281571f2b 00000100:00100000:2.0:1790710968.908663:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1877696177078144:0@lo:400:kworker.0 00002000:00100000:3.0:1790710968.908672:0:15148:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9c51c6526800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1790710968.908676:0:15148:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1790710968.908679:0:15148:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1790710968.908691:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710968.908709:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790710968.908714:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1877696177078272:0@lo:400:kworker.0 00000100:00100000:2.0:1790710968.908734:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710968.908764:0:14464:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177078144 00000100:00100000:2.0:1790710968.908768:0:14464:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177078144 00000100:00100000:2.0:1790710968.908799:0:14464:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177078272 00000100:00100000:2.0:1790710968.908802:0:14464:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177078272 00000100:00100000:2.0:1790710968.908817:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790710968.908822:0:14464:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1877696177078144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790710968.908856:0:14464:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1877696177078144:12345-0@lo:400:kworker.0 Request processed in 33us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710968.908861:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790710968.908876:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790710968.908882:0:14464:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1877696177078272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790710968.908907:0:14464:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1877696177078272:12345-0@lo:400:kworker.0 Request processed in 25us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710968.908912:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1790710968.908928:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1790710968.908947:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51f4d62680 x1877696177078272/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790710984 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790710968.908956:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1877696177078272:0@lo:400:kworker.0 00002000:00080000:3.0:1790710968.909041:0:15148:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1790710968.909061:0:15148:0:(import.c:65:import_set_state_nolock()) ffff9c51c6522800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790710968.909096:0:15148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c50c35b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1877696177077760:12345-0@lo:8:kworker.0 Request processed in 499us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710968.909103:0:15148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1790710968.909690:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51f4d60380 x1877696177078144/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790710984 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790710968.909701:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1877696177078144:0@lo:400:kworker.0 00000100:00100000:2.0:1790710968.909728:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1877696177077888:0@lo:8:kworker.0 00000100:00100000:2.0:1790710968.909762:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1790710968.909795:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51f4d61f80 x1877696177077760/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790710988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790710968.909803:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790710968.909809:0:3308:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1790710968.909815:0:3308:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1790710968.909820:0:3308:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1790710968.909823:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9c51f444d800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1790710968.909833:0:3308:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1790710968.909838:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1877696177077760:0@lo:8:kworker.0 00000100:00100000:2.0:1790710968.909865:0:15150:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177077888 00000100:00100000:2.0:1790710968.909869:0:15150:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177077888 00000100:00100000:2.0:1790710968.909887:0:15150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790710968.909892:0:15150:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3308:x1877696177077888:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1790710968.909910:0:15150:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 446 last 0 00000020:00000080:2.0:1790710968.909929:0:15150:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcbad34b281571f32 00002000:00100000:2.0:1790710968.909937:0:15150:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9c50c2744800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1790710968.909940:0:15150:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1790710968.909942:0:15150:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000004:00080000:0.0:1790710968.910092:0:14487:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:0.0:1790710968.910109:0:14487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c50c35b2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14487:1877696177078528:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1790710968.910155:0:14487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710968.910171:0:14487:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51d8a96480 going to sleep for 11 seconds 00000100:00100000:0.0:1790710968.910186:0:15149:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1790710968.910192:0:15149:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1790710968.910307:0:15149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177078528 00000100:00100000:0.0:1790710968.910312:0:15149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177078528 00000100:00100000:0.0:1790710968.910386:0:16041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790710968.910394:0:16041:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c50c35b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14487:x1877696177078528:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1790710968.911303:0:15150:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1790710968.911333:0:15150:0:(import.c:65:import_set_state_nolock()) ffff9c50c2745800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790710968.911393:0:15150:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3308:x1877696177077888:12345-0@lo:8:kworker.0 Request processed in 1499us (1630us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710968.911401:0:15150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000004:00080000:2.0:1790710968.911429:0:14486:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1790710968.911771:0:14486:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 446248642273ns, next at 0ns, rc = 0 00000100:00080000:2.0:1790710968.912074:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790710968.912407:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c50c35b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1877696177078400:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790710968.912455:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710968.912483:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790710968.912489:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877696177078016:0@lo:400:kworker.0 00000100:00100000:2.0:1790710968.912512:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710968.912539:0:14464:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177078016 00000100:00100000:2.0:1790710968.912545:0:14464:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177078016 00000100:00100000:2.0:1790710968.912580:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790710968.912588:0:14464:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877696177078016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790710968.912644:0:14464:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877696177078016:12345-0@lo:400:kworker.0 Request processed in 56us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710968.912651:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1790710968.912691:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51f4d61180 x1877696177077888/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790710988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790710968.912702:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790710968.912710:0:3308:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1790710968.912718:0:3308:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1790710968.912722:0:3308:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1790710968.912725:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9c51d02d9800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1790710968.912853:0:15151:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177078400 00000100:00100000:3.0:1790710968.912875:0:15151:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177078400 00000100:00100000:3.0:1790710968.912903:0:15151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790710968.912910:0:15151:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1877696177078400:12345-0@lo:13:osp-pre-0-0.0 00000004:00080000:1.0:1790710968.913040:0:14489:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:1.0:1790710968.913056:0:14489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51ff87ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14489:1877696177078784:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1790710968.913086:0:14489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710968.913103:0:14489:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f979ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1790710968.913196:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51ff87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1877696177078656:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790710968.913218:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710968.913246:0:15149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177078784 00000100:00100000:1.0:1790710968.913250:0:15149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177078784 00000100:00100000:1.0:1790710968.913282:0:15149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790710968.913302:0:15149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff87e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14489:x1877696177078784:12345-0@lo:5:osp-pre-1-0.0 00002000:00000024:3.0:1790710968.914101:0:15151:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790710968.914173:0:15151:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1877696177078400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1262us (1715us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710968.914180:0:15151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790710968.914200:0:15151:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177078656 00000100:00100000:3.0:1790710968.914204:0:15151:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177078656 00000100:00100000:3.0:1790710968.914222:0:15151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790710968.914228:0:15151:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff87c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1877696177078656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790710968.914244:0:15151:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790710968.914278:0:15151:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff87c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1877696177078656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (1059us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710968.914284:0:15151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00002000:00080000:0.0:1790710968.915915:0:16041:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1790710968.915924:0:16041:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1790710968.915928:0:16041:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00000004:00080000:2.0:1790710968.917673:0:3308:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1790710968.917693:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1877696177077888:0@lo:8:kworker.0 00010000:00080000:2.0:1790710968.917964:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51f4d63100 x1877696177078016/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790710984 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790710968.917979:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877696177078016:0@lo:400:kworker.0 00010000:00080000:2.0:1790710968.917993:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c50c35b3100 x1877696177078400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790710984 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790710968.918010:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c50c35b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1877696177078400:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1790710968.918761:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1790710968.918793:0:14488:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1790710968.919101:0:14488:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 446255972536ns, next at 0ns, rc = 0 00002000:00080000:1.0:1790710968.921270:0:15149:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1790710968.921280:0:15149:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1790710968.921285:0:15149:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00002000:00010000:0.0:1790710968.928539:0:16041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790710968.928553:0:16041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7f82dca/0xcbad34b281571f39 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.928570:0:16041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=446s v=(0 0) 00010000:00010000:0.0:1790710968.928574:0:16041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790710968.928580:0:16041:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7f82dca/0xcbad34b281571f39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.928598:0:16041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e7f82dca/0xcbad34b281571f39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.928609:0:16041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7f82dca/0xcbad34b281571f39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.928617:0:16041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e7f82dca/0xcbad34b281571f39 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.928645:0:16041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790710968.929171:0:16041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790710968.929178:0:16041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000646b643/0xcbad34b281571f40 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.929188:0:16041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=446s v=(0 0) 00010000:00010000:0.0:1790710968.929198:0:16041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790710968.929203:0:16041:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000646b643/0xcbad34b281571f40 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.929213:0:16041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000646b643/0xcbad34b281571f40 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.929221:0:16041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000646b643/0xcbad34b281571f40 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.929229:0:16041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000646b643/0xcbad34b281571f40 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.929244:0:16041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1790710968.929610:0:16041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790710968.929617:0:16041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afd19897/0xcbad34b281571f47 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.929634:0:16041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=446s v=(0 0) 00010000:00010000:0.0:1790710968.929637:0:16041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790710968.929641:0:16041:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afd19897/0xcbad34b281571f47 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.929649:0:16041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afd19897/0xcbad34b281571f47 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.929656:0:16041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afd19897/0xcbad34b281571f47 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.929670:0:16041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000afd19897/0xcbad34b281571f47 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.929677:0:16041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1790710968.931208:0:16041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790710968.931217:0:16041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba10cfb7/0xcbad34b281571f4e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.931231:0:16041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=446s v=(0 0) 00010000:00010000:0.0:1790710968.931235:0:16041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790710968.931239:0:16041:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba10cfb7/0xcbad34b281571f4e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.931251:0:16041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba10cfb7/0xcbad34b281571f4e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.931260:0:16041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba10cfb7/0xcbad34b281571f4e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.931268:0:16041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba10cfb7/0xcbad34b281571f4e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.931278:0:16041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:2.0:1790710968.931823:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1790710968.931831:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e7f82dca/0xcbad34b281571f39 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.931840:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c243a800 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:2.0:1790710968.931845:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7f82dca/0xcbad34b281571f39 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.931856:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7f82dca/0xcbad34b281571f39 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.931875:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e7f82dca/0xcbad34b281571f39 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.931883:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7f82dca/0xcbad34b281571f39 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.931914:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1790710968.931918:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000646b643/0xcbad34b281571f40 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.931925:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c243aa00 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:2.0:1790710968.931928:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000646b643/0xcbad34b281571f40 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.931935:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000646b643/0xcbad34b281571f40 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.931945:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000646b643/0xcbad34b281571f40 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.931952:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000646b643/0xcbad34b281571f40 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790710968.933434:0:16041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790710968.933445:0:16041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0bdfb23/0xcbad34b281571f55 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.933465:0:16041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=446s v=(0 0) 00010000:00010000:0.0:1790710968.934773:0:16041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790710968.934785:0:16041:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0bdfb23/0xcbad34b281571f55 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.934801:0:16041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0bdfb23/0xcbad34b281571f55 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.934812:0:16041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0bdfb23/0xcbad34b281571f55 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.934820:0:16041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0bdfb23/0xcbad34b281571f55 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.934831:0:16041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1790710968.937816:0:16041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790710968.937826:0:16041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001279e329/0xcbad34b281571f5c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.937843:0:16041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=446s v=(0 0) 00010000:00010000:0.0:1790710968.937848:0:16041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790710968.937854:0:16041:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001279e329/0xcbad34b281571f5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.937868:0:16041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001279e329/0xcbad34b281571f5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.937890:0:16041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001279e329/0xcbad34b281571f5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.937899:0:16041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001279e329/0xcbad34b281571f5c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.937910:0:16041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1790710968.938290:0:16041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790710968.938296:0:16041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066d59ee7/0xcbad34b281571f63 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.938304:0:16041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=446s v=(0 0) 00010000:00010000:0.0:1790710968.938307:0:16041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790710968.938311:0:16041:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066d59ee7/0xcbad34b281571f63 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.938320:0:16041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000066d59ee7/0xcbad34b281571f63 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.938327:0:16041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066d59ee7/0xcbad34b281571f63 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.938335:0:16041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000066d59ee7/0xcbad34b281571f63 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.938352:0:16041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:0.0:1790710968.938753:0:16041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790710968.938760:0:16041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091004012/0xcbad34b281571f6a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.938769:0:16041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=446s v=(0 0) 00010000:00010000:0.0:1790710968.938772:0:16041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790710968.938776:0:16041:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091004012/0xcbad34b281571f6a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.938785:0:16041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000091004012/0xcbad34b281571f6a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.938792:0:16041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091004012/0xcbad34b281571f6a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.938798:0:16041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000091004012/0xcbad34b281571f6a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.938806:0:16041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:2.0:1790710968.939296:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1790710968.939304:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000afd19897/0xcbad34b281571f47 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.939313:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c243a000 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:2.0:1790710968.939318:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000afd19897/0xcbad34b281571f47 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.939339:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000afd19897/0xcbad34b281571f47 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.939355:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000afd19897/0xcbad34b281571f47 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.939363:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afd19897/0xcbad34b281571f47 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.939384:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1790710968.939388:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba10cfb7/0xcbad34b281571f4e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.939394:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c243bc00 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:2.0:1790710968.939397:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba10cfb7/0xcbad34b281571f4e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.939404:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba10cfb7/0xcbad34b281571f4e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.939413:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba10cfb7/0xcbad34b281571f4e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.939420:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba10cfb7/0xcbad34b281571f4e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.939441:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1790710968.939445:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0bdfb23/0xcbad34b281571f55 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.939452:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c243a200 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:2.0:1790710968.939455:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0bdfb23/0xcbad34b281571f55 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.939462:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0bdfb23/0xcbad34b281571f55 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.939472:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0bdfb23/0xcbad34b281571f55 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.939480:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0bdfb23/0xcbad34b281571f55 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.939491:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1790710968.939494:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001279e329/0xcbad34b281571f5c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.939500:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c243ba00 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:2.0:1790710968.939504:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001279e329/0xcbad34b281571f5c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.939521:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001279e329/0xcbad34b281571f5c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.939530:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001279e329/0xcbad34b281571f5c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.939537:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001279e329/0xcbad34b281571f5c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.939549:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790710968.939553:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000066d59ee7/0xcbad34b281571f63 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.939558:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c243ae00 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:2.0:1790710968.939561:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000066d59ee7/0xcbad34b281571f63 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.939568:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000066d59ee7/0xcbad34b281571f63 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.939577:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000066d59ee7/0xcbad34b281571f63 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.939584:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000066d59ee7/0xcbad34b281571f63 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.939609:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790710968.939612:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000091004012/0xcbad34b281571f6a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.939619:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c243a600 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:2.0:1790710968.939714:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000091004012/0xcbad34b281571f6a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.939722:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000091004012/0xcbad34b281571f6a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.939732:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000091004012/0xcbad34b281571f6a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.939739:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000091004012/0xcbad34b281571f6a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.939752:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710968.939754:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710968.939756:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710968.939802:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710968.939805:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710968.939807:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790710968.943398:0:15149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790710968.943410:0:15149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053ec4020/0xcbad34b281571f71 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.943428:0:15149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1790710968.943432:0:15149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790710968.943438:0:15149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053ec4020/0xcbad34b281571f71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.943456:0:15149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000053ec4020/0xcbad34b281571f71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.943479:0:15149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053ec4020/0xcbad34b281571f71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.943487:0:15149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000053ec4020/0xcbad34b281571f71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.943505:0:15149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1790710968.944323:0:15149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790710968.944331:0:15149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf8f2540/0xcbad34b281571f78 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.944341:0:15149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1790710968.944345:0:15149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790710968.944350:0:15149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf8f2540/0xcbad34b281571f78 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.944360:0:15149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf8f2540/0xcbad34b281571f78 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.944367:0:15149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf8f2540/0xcbad34b281571f78 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.944374:0:15149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cf8f2540/0xcbad34b281571f78 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.944404:0:15149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1790710968.944703:0:16041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790710968.944711:0:16041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000158f7a14/0xcbad34b281571f7f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.944721:0:16041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=446s v=(0 0) 00010000:00010000:0.0:1790710968.944729:0:16041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790710968.944734:0:16041:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000158f7a14/0xcbad34b281571f7f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.944745:0:16041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000158f7a14/0xcbad34b281571f7f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.944753:0:16041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000158f7a14/0xcbad34b281571f7f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.944761:0:16041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000158f7a14/0xcbad34b281571f7f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.944769:0:16041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1790710968.945205:0:16041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790710968.945211:0:16041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051061c53/0xcbad34b281571f86 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.945220:0:16041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=446s v=(0 0) 00010000:00010000:0.0:1790710968.945224:0:16041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790710968.945228:0:16041:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051061c53/0xcbad34b281571f86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.945237:0:16041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051061c53/0xcbad34b281571f86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.945244:0:16041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051061c53/0xcbad34b281571f86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.945259:0:16041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000051061c53/0xcbad34b281571f86 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.945267:0:16041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1790710968.945610:0:16041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790710968.945616:0:16041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a6174e4/0xcbad34b281571f8d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.945639:0:16041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=446s v=(0 0) 00010000:00010000:0.0:1790710968.945641:0:16041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790710968.945645:0:16041:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a6174e4/0xcbad34b281571f8d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.945654:0:16041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a6174e4/0xcbad34b281571f8d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.945661:0:16041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a6174e4/0xcbad34b281571f8d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.945668:0:16041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a6174e4/0xcbad34b281571f8d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.945676:0:16041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1790710968.946066:0:15149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790710968.946074:0:15149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe3d36c7/0xcbad34b281571f94 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.946084:0:15149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1790710968.946088:0:15149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790710968.946093:0:15149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe3d36c7/0xcbad34b281571f94 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.946102:0:15149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe3d36c7/0xcbad34b281571f94 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.946110:0:15149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe3d36c7/0xcbad34b281571f94 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.946117:0:15149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fe3d36c7/0xcbad34b281571f94 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.946149:0:15149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:0.0:1790710968.946225:0:16041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790710968.946232:0:16041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033a1ad47/0xcbad34b281571f9b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.946246:0:16041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=446s v=(0 0) 00010000:00010000:0.0:1790710968.946250:0:16041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790710968.946254:0:16041:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033a1ad47/0xcbad34b281571f9b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.946297:0:16041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033a1ad47/0xcbad34b281571f9b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.946305:0:16041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033a1ad47/0xcbad34b281571f9b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.946312:0:16041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000033a1ad47/0xcbad34b281571f9b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.946320:0:16041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:0.0:1790710968.946760:0:16041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790710968.946766:0:16041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000360055a3/0xcbad34b281571fa2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.946776:0:16041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=446s v=(0 0) 00010000:00010000:0.0:1790710968.946779:0:16041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790710968.946783:0:16041:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000360055a3/0xcbad34b281571fa2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.946793:0:16041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000360055a3/0xcbad34b281571fa2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.946812:0:16041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000360055a3/0xcbad34b281571fa2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.946819:0:16041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000360055a3/0xcbad34b281571fa2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.946829:0:16041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:1.0:1790710968.946979:0:15149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790710968.946985:0:15149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004dcaf274/0xcbad34b281571fa9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.946994:0:15149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1790710968.947003:0:15149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790710968.947007:0:15149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004dcaf274/0xcbad34b281571fa9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.947017:0:15149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004dcaf274/0xcbad34b281571fa9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.947026:0:15149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004dcaf274/0xcbad34b281571fa9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.947034:0:15149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004dcaf274/0xcbad34b281571fa9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.947043:0:15149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:1.0:1790710968.947517:0:15149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790710968.947524:0:15149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa52bd29/0xcbad34b281571fb0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.947533:0:15149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1790710968.947536:0:15149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790710968.947540:0:15149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa52bd29/0xcbad34b281571fb0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.947549:0:15149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aa52bd29/0xcbad34b281571fb0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.947556:0:15149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa52bd29/0xcbad34b281571fb0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.947569:0:15149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aa52bd29/0xcbad34b281571fb0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.947578:0:15149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00010000:00080000:2.0:1790710968.948088:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51ff87f100 x1877696177078656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790710984 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790710968.948145:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51ff87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1877696177078656:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1790710968.948189:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:2.0:1790710968.948197:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000053ec4020/0xcbad34b281571f71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.948207:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c6480a00 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:2.0:1790710968.948212:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000053ec4020/0xcbad34b281571f71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.948223:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000053ec4020/0xcbad34b281571f71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.948243:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000053ec4020/0xcbad34b281571f71 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.948250:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000053ec4020/0xcbad34b281571f71 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.948271:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:2.0:1790710968.948274:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cf8f2540/0xcbad34b281571f78 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.948281:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c6481800 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:2.0:1790710968.948285:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf8f2540/0xcbad34b281571f78 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.948294:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf8f2540/0xcbad34b281571f78 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790710968.948295:0:15149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790710968.948303:0:15149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004efb5ff1/0xcbad34b281571fb7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.948314:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cf8f2540/0xcbad34b281571f78 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.948315:0:15149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1790710968.948323:0:15149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790710968.948333:0:15149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004efb5ff1/0xcbad34b281571fb7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.948334:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf8f2540/0xcbad34b281571f78 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.948355:0:15149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004efb5ff1/0xcbad34b281571fb7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.948359:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:2.0:1790710968.948365:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000158f7a14/0xcbad34b281571f7f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.948367:0:15149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004efb5ff1/0xcbad34b281571fb7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.948382:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c0030e00 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:1.0:1790710968.948385:0:15149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004efb5ff1/0xcbad34b281571fb7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.948387:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000158f7a14/0xcbad34b281571f7f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.948406:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000158f7a14/0xcbad34b281571f7f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.948407:0:15149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00010000:00010000:2.0:1790710968.948421:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000158f7a14/0xcbad34b281571f7f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.948429:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000158f7a14/0xcbad34b281571f7f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.948445:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:2.0:1790710968.948449:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000051061c53/0xcbad34b281571f86 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.948462:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c0031000 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:2.0:1790710968.948465:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000051061c53/0xcbad34b281571f86 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.948480:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000051061c53/0xcbad34b281571f86 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.948494:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000051061c53/0xcbad34b281571f86 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.948501:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051061c53/0xcbad34b281571f86 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.948517:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1790710968.948521:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a6174e4/0xcbad34b281571f8d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.948528:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c0030400 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:2.0:1790710968.948531:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a6174e4/0xcbad34b281571f8d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.948540:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a6174e4/0xcbad34b281571f8d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.948551:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a6174e4/0xcbad34b281571f8d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.948564:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a6174e4/0xcbad34b281571f8d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.948581:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1790710968.948585:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fe3d36c7/0xcbad34b281571f94 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.948592:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c6480600 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:2.0:1790710968.948595:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe3d36c7/0xcbad34b281571f94 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.948603:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe3d36c7/0xcbad34b281571f94 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.948612:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fe3d36c7/0xcbad34b281571f94 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.948618:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe3d36c7/0xcbad34b281571f94 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.948640:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1790710968.948644:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000033a1ad47/0xcbad34b281571f9b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.948649:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c0030a00 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:2.0:1790710968.948658:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000033a1ad47/0xcbad34b281571f9b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.948666:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000033a1ad47/0xcbad34b281571f9b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.948675:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000033a1ad47/0xcbad34b281571f9b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.948681:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033a1ad47/0xcbad34b281571f9b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.948694:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1790710968.948697:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000360055a3/0xcbad34b281571fa2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.948702:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c0030800 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:2.0:1790710968.948705:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000360055a3/0xcbad34b281571fa2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.948713:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000360055a3/0xcbad34b281571fa2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.948722:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000360055a3/0xcbad34b281571fa2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.948728:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000360055a3/0xcbad34b281571fa2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.948748:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1790710968.948752:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004dcaf274/0xcbad34b281571fa9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.948758:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c6480200 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:2.0:1790710968.948760:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004dcaf274/0xcbad34b281571fa9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.948768:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004dcaf274/0xcbad34b281571fa9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.948778:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004dcaf274/0xcbad34b281571fa9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.948785:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004dcaf274/0xcbad34b281571fa9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.948797:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790710968.948800:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aa52bd29/0xcbad34b281571fb0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.948806:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c6481200 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:2.0:1790710968.948809:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa52bd29/0xcbad34b281571fb0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.948826:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa52bd29/0xcbad34b281571fb0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.948836:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aa52bd29/0xcbad34b281571fb0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.948842:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa52bd29/0xcbad34b281571fb0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.948853:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790710968.948857:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004efb5ff1/0xcbad34b281571fb7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.948863:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c6481c00 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:2.0:1790710968.948865:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004efb5ff1/0xcbad34b281571fb7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.948873:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004efb5ff1/0xcbad34b281571fb7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.948882:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004efb5ff1/0xcbad34b281571fb7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.948888:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004efb5ff1/0xcbad34b281571fb7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.948911:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710968.948913:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710968.948915:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710968.948937:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790710968.949967:0:15149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790710968.949977:0:15149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095471a74/0xcbad34b281571fbe lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.949998:0:15149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1790710968.950002:0:15149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790710968.950006:0:15149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000095471a74/0xcbad34b281571fbe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.950018:0:15149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000095471a74/0xcbad34b281571fbe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.950027:0:15149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095471a74/0xcbad34b281571fbe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.950034:0:15149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000095471a74/0xcbad34b281571fbe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.950053:0:15149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1790710968.950745:0:15149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790710968.950753:0:15149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004516a194/0xcbad34b281571fc5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.950834:0:15149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1790710968.950837:0:15149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790710968.950841:0:15149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004516a194/0xcbad34b281571fc5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.950850:0:15149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004516a194/0xcbad34b281571fc5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.950868:0:15149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004516a194/0xcbad34b281571fc5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.950875:0:15149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004516a194/0xcbad34b281571fc5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.950895:0:15149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1790710968.950910:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790710968.950916:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000095471a74/0xcbad34b281571fbe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.950923:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c6480000 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:1.0:1790710968.950927:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000095471a74/0xcbad34b281571fbe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.950935:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000095471a74/0xcbad34b281571fbe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.950949:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000095471a74/0xcbad34b281571fbe lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.950956:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000095471a74/0xcbad34b281571fbe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.950974:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790710968.950982:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004516a194/0xcbad34b281571fc5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.950989:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c6481a00 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:1.0:1790710968.950992:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004516a194/0xcbad34b281571fc5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.950998:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004516a194/0xcbad34b281571fc5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.951009:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004516a194/0xcbad34b281571fc5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.951015:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004516a194/0xcbad34b281571fc5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.951029:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790710968.951031:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790710968.951033:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790710968.951527:0:15149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790710968.951534:0:15149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd24760f/0xcbad34b281571fcc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.951545:0:15149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1790710968.951549:0:15149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790710968.951553:0:15149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd24760f/0xcbad34b281571fcc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.951573:0:15149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd24760f/0xcbad34b281571fcc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.951582:0:15149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd24760f/0xcbad34b281571fcc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.951589:0:15149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cd24760f/0xcbad34b281571fcc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.951750:0:15149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790710968.951832:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790710968.951837:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cd24760f/0xcbad34b281571fcc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.951845:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c6480c00 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:1.0:1790710968.951848:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd24760f/0xcbad34b281571fcc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.951857:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd24760f/0xcbad34b281571fcc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.951869:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cd24760f/0xcbad34b281571fcc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.951877:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd24760f/0xcbad34b281571fcc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.951897:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790710968.951899:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790710968.951901:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710968.952845:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790710968.952891:0:15149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790710968.952899:0:15149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e50bad2/0xcbad34b281571fd3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.952909:0:15149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1790710968.952913:0:15149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790710968.952919:0:15149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e50bad2/0xcbad34b281571fd3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.952930:0:15149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e50bad2/0xcbad34b281571fd3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.952939:0:15149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e50bad2/0xcbad34b281571fd3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.952946:0:15149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009e50bad2/0xcbad34b281571fd3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.953012:0:15149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790710968.953373:0:16041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790710968.953381:0:16041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cdb18a6/0xcbad34b281571fda lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.953391:0:16041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=446s v=(0 0) 00010000:00010000:0.0:1790710968.953396:0:16041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790710968.953401:0:16041:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008cdb18a6/0xcbad34b281571fda lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.953413:0:16041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008cdb18a6/0xcbad34b281571fda lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.953421:0:16041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cdb18a6/0xcbad34b281571fda lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.953429:0:16041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008cdb18a6/0xcbad34b281571fda lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790710968.953565:0:15149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790710968.953570:0:15149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000189389e8/0xcbad34b281571fe1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.953589:0:15149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1790710968.953592:0:15149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790710968.953676:0:15149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000189389e8/0xcbad34b281571fe1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.953687:0:15149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000189389e8/0xcbad34b281571fe1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.953695:0:15149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000189389e8/0xcbad34b281571fe1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.953702:0:15149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000189389e8/0xcbad34b281571fe1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.953863:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1790710968.953870:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009e50bad2/0xcbad34b281571fd3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.953878:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c6480400 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:2.0:1790710968.953882:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009e50bad2/0xcbad34b281571fd3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.953891:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009e50bad2/0xcbad34b281571fd3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.953906:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009e50bad2/0xcbad34b281571fd3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.953914:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e50bad2/0xcbad34b281571fd3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.954154:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790710968.954158:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008cdb18a6/0xcbad34b281571fda lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.954176:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c0030200 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:2.0:1790710968.954180:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008cdb18a6/0xcbad34b281571fda lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.954187:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008cdb18a6/0xcbad34b281571fda lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.954198:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008cdb18a6/0xcbad34b281571fda lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.954209:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790710968.954228:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000189389e8/0xcbad34b281571fe1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.954242:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c6480800 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:2.0:1790710968.954246:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000189389e8/0xcbad34b281571fe1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.954253:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000189389e8/0xcbad34b281571fe1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.954264:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000189389e8/0xcbad34b281571fe1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.954422:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710968.954429:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710968.954431:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790710968.954704:0:15149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1790710968.954710:0:15149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000189389e8/0xcbad34b281571fe1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.954733:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790710968.955020:0:16041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1790710968.955028:0:16041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008cdb18a6/0xcbad34b281571fda lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.955059:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790710968.955409:0:15149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790710968.955416:0:15149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d334644/0xcbad34b281571fe8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.955427:0:15149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1790710968.955431:0:15149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790710968.955436:0:15149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d334644/0xcbad34b281571fe8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.955455:0:15149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003d334644/0xcbad34b281571fe8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.955464:0:15149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d334644/0xcbad34b281571fe8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.955472:0:15149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003d334644/0xcbad34b281571fe8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.955486:0:15149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790710968.955494:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790710968.955498:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003d334644/0xcbad34b281571fe8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.955504:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51ff135e00 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:1.0:1790710968.955508:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003d334644/0xcbad34b281571fe8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.955516:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003d334644/0xcbad34b281571fe8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.955527:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003d334644/0xcbad34b281571fe8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.955534:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003d334644/0xcbad34b281571fe8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.955555:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790710968.955557:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790710968.955558:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790710968.955789:0:16041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790710968.955796:0:16041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7d97434/0xcbad34b281571fef lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.955805:0:16041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=446s v=(0 0) 00010000:00010000:0.0:1790710968.955808:0:16041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790710968.955813:0:16041:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7d97434/0xcbad34b281571fef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.955823:0:16041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b7d97434/0xcbad34b281571fef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.955831:0:16041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7d97434/0xcbad34b281571fef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.955839:0:16041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b7d97434/0xcbad34b281571fef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.955854:0:16041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790710968.955863:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790710968.955874:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b7d97434/0xcbad34b281571fef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.955881:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c0031a00 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:0.0:1790710968.955886:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7d97434/0xcbad34b281571fef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.955895:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7d97434/0xcbad34b281571fef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.955908:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b7d97434/0xcbad34b281571fef lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.955916:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7d97434/0xcbad34b281571fef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.955933:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790710968.955935:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790710968.955938:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790710968.956865:0:16041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790710968.956873:0:16041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6e0af5d/0xcbad34b281571ff6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.956885:0:16041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=446s v=(0 0) 00010000:00010000:0.0:1790710968.956889:0:16041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790710968.956894:0:16041:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6e0af5d/0xcbad34b281571ff6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.956914:0:16041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6e0af5d/0xcbad34b281571ff6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.956922:0:16041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6e0af5d/0xcbad34b281571ff6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.956929:0:16041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6e0af5d/0xcbad34b281571ff6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.956949:0:16041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790710968.957799:0:16041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790710968.957807:0:16041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2ef2055/0xcbad34b281571ffd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.957819:0:16041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=446s v=(0 0) 00010000:00010000:0.0:1790710968.957823:0:16041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790710968.957828:0:16041:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2ef2055/0xcbad34b281571ffd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.957838:0:16041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2ef2055/0xcbad34b281571ffd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.957846:0:16041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2ef2055/0xcbad34b281571ffd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.957864:0:16041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2ef2055/0xcbad34b281571ffd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.957881:0:16041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1790710968.957896:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790710968.957901:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6e0af5d/0xcbad34b281571ff6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.957909:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c0031800 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:0.0:1790710968.957913:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6e0af5d/0xcbad34b281571ff6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.957922:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6e0af5d/0xcbad34b281571ff6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.957938:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6e0af5d/0xcbad34b281571ff6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.957946:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6e0af5d/0xcbad34b281571ff6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.957970:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790710968.957973:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2ef2055/0xcbad34b281571ffd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.957990:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790710968.957993:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c0030c00 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:0.0:1790710968.957997:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2ef2055/0xcbad34b281571ffd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.958006:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2ef2055/0xcbad34b281571ffd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.958017:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2ef2055/0xcbad34b281571ffd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.958024:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2ef2055/0xcbad34b281571ffd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.958041:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790710968.958043:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790710968.958045:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790710968.958342:0:15149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790710968.958349:0:15149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cfd42d3c/0xcbad34b281572004 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.958359:0:15149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1790710968.958363:0:15149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790710968.958368:0:15149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cfd42d3c/0xcbad34b281572004 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.958377:0:15149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cfd42d3c/0xcbad34b281572004 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.958386:0:15149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cfd42d3c/0xcbad34b281572004 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.958394:0:15149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cfd42d3c/0xcbad34b281572004 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.958527:0:15149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790710968.958828:0:16041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790710968.958835:0:16041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed8d8e52/0xcbad34b28157200b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.958844:0:16041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=446s v=(0 0) 00010000:00010000:0.0:1790710968.958848:0:16041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790710968.958852:0:16041:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed8d8e52/0xcbad34b28157200b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.958862:0:16041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed8d8e52/0xcbad34b28157200b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.958877:0:16041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed8d8e52/0xcbad34b28157200b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.958884:0:16041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ed8d8e52/0xcbad34b28157200b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790710968.959087:0:15149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790710968.959094:0:15149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079e15a26/0xcbad34b281572012 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.959111:0:15149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1790710968.959114:0:15149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790710968.959119:0:15149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000079e15a26/0xcbad34b281572012 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.959169:0:15149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000079e15a26/0xcbad34b281572012 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.959179:0:15149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079e15a26/0xcbad34b281572012 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.959186:0:15149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000079e15a26/0xcbad34b281572012 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.959652:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1790710968.959660:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cfd42d3c/0xcbad34b281572004 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.959668:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51ff135c00 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:2.0:1790710968.959673:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cfd42d3c/0xcbad34b281572004 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.959683:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cfd42d3c/0xcbad34b281572004 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.959698:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cfd42d3c/0xcbad34b281572004 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.959707:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cfd42d3c/0xcbad34b281572004 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.959723:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790710968.959727:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ed8d8e52/0xcbad34b28157200b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.959734:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c0031600 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:2.0:1790710968.959738:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed8d8e52/0xcbad34b28157200b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.959766:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed8d8e52/0xcbad34b28157200b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.959779:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ed8d8e52/0xcbad34b28157200b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.959789:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790710968.959792:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000079e15a26/0xcbad34b281572012 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.959799:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51ff135a00 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:2.0:1790710968.959802:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000079e15a26/0xcbad34b281572012 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.959809:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000079e15a26/0xcbad34b281572012 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.959817:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000079e15a26/0xcbad34b281572012 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.959823:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710968.959824:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710968.959826:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1790710968.960336:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:0.0:1790710968.960431:0:16041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1790710968.960438:0:16041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed8d8e52/0xcbad34b28157200b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710968.960997:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790710968.961070:0:16041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790710968.961077:0:16041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cdb18a6/0xcbad34b281572019 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.961090:0:16041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=446s v=(0 0) 00010000:00010000:0.0:1790710968.961094:0:16041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790710968.961099:0:16041:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008cdb18a6/0xcbad34b281572019 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.961112:0:16041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008cdb18a6/0xcbad34b281572019 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.961120:0:16041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cdb18a6/0xcbad34b281572019 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.961576:0:16041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008cdb18a6/0xcbad34b281572019 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.961955:0:16041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790710968.962502:0:15149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790710968.962504:0:16041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790710968.962512:0:15149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000079e15a26/0xcbad34b281572012 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.962513:0:16041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d32b55d/0xcbad34b281572020 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.962536:0:16041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=446s v=(0 0) 00010000:00010000:0.0:1790710968.962540:0:16041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790710968.962546:0:16041:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d32b55d/0xcbad34b281572020 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.962555:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790710968.962559:0:16041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d32b55d/0xcbad34b281572020 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.962562:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008cdb18a6/0xcbad34b281572019 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.962575:0:16041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d32b55d/0xcbad34b281572020 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.962576:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c0030200 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:1.0:1790710968.962582:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008cdb18a6/0xcbad34b281572019 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.962588:0:16041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d32b55d/0xcbad34b281572020 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.962600:0:16041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790710968.962689:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008cdb18a6/0xcbad34b281572019 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.962709:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008cdb18a6/0xcbad34b281572019 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.962716:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008cdb18a6/0xcbad34b281572019 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.962734:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790710968.962738:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d32b55d/0xcbad34b281572020 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.962744:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c0030000 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:1.0:1790710968.962747:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d32b55d/0xcbad34b281572020 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.962755:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d32b55d/0xcbad34b281572020 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.962765:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d32b55d/0xcbad34b281572020 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.962773:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d32b55d/0xcbad34b281572020 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.962801:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790710968.962803:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790710968.962805:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790710968.963074:0:16041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790710968.963081:0:16041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000360055a3/0xcbad34b281572027 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.963095:0:16041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=446s v=(0 0) 00010000:00010000:0.0:1790710968.963099:0:16041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790710968.963103:0:16041:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000360055a3/0xcbad34b281572027 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.963113:0:16041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000360055a3/0xcbad34b281572027 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.963120:0:16041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000360055a3/0xcbad34b281572027 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.963154:0:16041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000360055a3/0xcbad34b281572027 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.963169:0:16041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790710968.963190:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790710968.963196:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000360055a3/0xcbad34b281572027 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.963203:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c0030800 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:1.0:1790710968.963207:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000360055a3/0xcbad34b281572027 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.963215:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000360055a3/0xcbad34b281572027 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.963227:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000360055a3/0xcbad34b281572027 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.963247:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000360055a3/0xcbad34b281572027 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.963262:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790710968.963265:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790710968.963267:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790710968.964080:0:15149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790710968.964089:0:15149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b271cda/0xcbad34b28157202e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710968.964100:0:15149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=446s v=(0 0) 00010000:00010000:3.0:1790710968.964105:0:15149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790710968.964109:0:15149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b271cda/0xcbad34b28157202e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710968.964121:0:15149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b271cda/0xcbad34b28157202e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710968.964219:0:15149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b271cda/0xcbad34b28157202e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710968.964227:0:15149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b271cda/0xcbad34b28157202e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710968.964818:0:15149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790710968.966463:0:16041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790710968.966485:0:16041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033a1ad47/0xcbad34b281572035 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.966500:0:16041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=446s v=(0 0) 00010000:00010000:0.0:1790710968.966505:0:16041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790710968.966510:0:16041:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033a1ad47/0xcbad34b281572035 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.966524:0:16041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033a1ad47/0xcbad34b281572035 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.966548:0:16041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033a1ad47/0xcbad34b281572035 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.966556:0:16041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000033a1ad47/0xcbad34b281572035 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790710968.966988:0:15149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790710968.966996:0:15149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4918146/0xcbad34b28157203c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710968.967011:0:15149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=446s v=(0 0) 00010000:00010000:3.0:1790710968.967015:0:15149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790710968.967023:0:15149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4918146/0xcbad34b28157203c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710968.967034:0:15149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f4918146/0xcbad34b28157203c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710968.967046:0:15149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4918146/0xcbad34b28157203c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710968.967057:0:15149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f4918146/0xcbad34b28157203c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.967524:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1790710968.967693:0:16041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1790710968.968859:0:15149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1790710968.968899:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790710968.968908:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000033a1ad47/0xcbad34b281572035 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.968929:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c0030a00 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:2.0:1790710968.968934:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000033a1ad47/0xcbad34b281572035 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.968946:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000033a1ad47/0xcbad34b281572035 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.968967:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000033a1ad47/0xcbad34b281572035 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.968975:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033a1ad47/0xcbad34b281572035 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790710968.969403:0:16041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790710968.969412:0:16041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2ef2055/0xcbad34b281572043 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.969424:0:16041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=446s v=(0 0) 00010000:00010000:0.0:1790710968.969428:0:16041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790710968.969434:0:16041:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2ef2055/0xcbad34b281572043 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.969446:0:16041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2ef2055/0xcbad34b281572043 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.969455:0:16041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2ef2055/0xcbad34b281572043 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.969463:0:16041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2ef2055/0xcbad34b281572043 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790710968.969494:0:15149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790710968.969501:0:15149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a068dcdb/0xcbad34b28157204a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710968.969511:0:15149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=446s v=(0 0) 00010000:00010000:3.0:1790710968.969515:0:15149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790710968.969519:0:15149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a068dcdb/0xcbad34b28157204a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710968.969529:0:15149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a068dcdb/0xcbad34b28157204a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710968.969537:0:15149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a068dcdb/0xcbad34b28157204a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710968.969545:0:15149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a068dcdb/0xcbad34b28157204a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710968.969555:0:15149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1790710968.969883:0:16041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1790710968.970446:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1790710968.970454:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f4918146/0xcbad34b28157203c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.970463:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c8046000 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:2.0:1790710968.970468:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4918146/0xcbad34b28157203c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.970478:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4918146/0xcbad34b28157203c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.970494:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f4918146/0xcbad34b28157203c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.970508:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f4918146/0xcbad34b28157203c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.970528:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790710968.970532:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a068dcdb/0xcbad34b28157204a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.970539:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c8046400 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:2.0:1790710968.970543:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a068dcdb/0xcbad34b28157204a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.970551:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a068dcdb/0xcbad34b28157204a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.970563:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a068dcdb/0xcbad34b28157204a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.970570:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a068dcdb/0xcbad34b28157204a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.970581:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790710968.970585:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2ef2055/0xcbad34b281572043 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.970591:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c0030c00 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:2.0:1790710968.970599:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2ef2055/0xcbad34b281572043 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.970607:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2ef2055/0xcbad34b281572043 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.970617:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2ef2055/0xcbad34b281572043 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.970635:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2ef2055/0xcbad34b281572043 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.970650:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710968.970652:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710968.970654:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790710968.970953:0:16041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790710968.970961:0:16041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6e0af5d/0xcbad34b281572051 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.970972:0:16041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=446s v=(0 0) 00010000:00010000:0.0:1790710968.970976:0:16041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790710968.970982:0:16041:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6e0af5d/0xcbad34b281572051 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.970993:0:16041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6e0af5d/0xcbad34b281572051 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.971001:0:16041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6e0af5d/0xcbad34b281572051 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.971009:0:16041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6e0af5d/0xcbad34b281572051 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.971031:0:16041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1790710968.971075:0:15149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790710968.971083:0:15149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f8ad5ed/0xcbad34b281572058 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710968.971093:0:15149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=446s v=(0 0) 00010000:00010000:3.0:1790710968.971102:0:15149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790710968.971107:0:15149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f8ad5ed/0xcbad34b281572058 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710968.971119:0:15149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f8ad5ed/0xcbad34b281572058 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710968.971144:0:15149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f8ad5ed/0xcbad34b281572058 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710968.971152:0:15149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f8ad5ed/0xcbad34b281572058 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710968.971161:0:15149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1790710968.971247:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790710968.971252:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6e0af5d/0xcbad34b281572051 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.971259:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c0031800 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:2.0:1790710968.971262:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6e0af5d/0xcbad34b281572051 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.971270:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6e0af5d/0xcbad34b281572051 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.971281:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6e0af5d/0xcbad34b281572051 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.971294:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6e0af5d/0xcbad34b281572051 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.971310:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790710968.971314:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f8ad5ed/0xcbad34b281572058 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.971320:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c8046600 already unused, calling callback (ffffffffc1692ac0) 00002000:00010000:0.0:1790710968.971801:0:16041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790710968.971807:0:16041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7d97434/0xcbad34b28157205f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.971817:0:16041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=446s v=(0 0) 00010000:00010000:0.0:1790710968.971826:0:16041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790710968.971831:0:16041:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7d97434/0xcbad34b28157205f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.971842:0:16041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b7d97434/0xcbad34b28157205f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.971850:0:16041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7d97434/0xcbad34b28157205f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.971858:0:16041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b7d97434/0xcbad34b28157205f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.971869:0:16041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1790710968.971955:0:15149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790710968.971962:0:15149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d8c7f00/0xcbad34b281572066 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710968.971971:0:15149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=446s v=(0 0) 00010000:00010000:3.0:1790710968.971974:0:15149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790710968.971978:0:15149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d8c7f00/0xcbad34b281572066 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710968.971988:0:15149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003d8c7f00/0xcbad34b281572066 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710968.971997:0:15149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d8c7f00/0xcbad34b281572066 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710968.972010:0:15149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003d8c7f00/0xcbad34b281572066 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710968.972019:0:15149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1790710968.972236:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f8ad5ed/0xcbad34b281572058 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.972246:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f8ad5ed/0xcbad34b281572058 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.972259:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f8ad5ed/0xcbad34b281572058 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.972266:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f8ad5ed/0xcbad34b281572058 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.972285:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790710968.972289:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b7d97434/0xcbad34b28157205f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.972295:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c0031a00 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:2.0:1790710968.972304:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7d97434/0xcbad34b28157205f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.972312:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7d97434/0xcbad34b28157205f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.972388:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b7d97434/0xcbad34b28157205f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.972397:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7d97434/0xcbad34b28157205f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.972414:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790710968.972418:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003d8c7f00/0xcbad34b281572066 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.972425:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c8047c00 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:2.0:1790710968.972429:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003d8c7f00/0xcbad34b281572066 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.972437:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003d8c7f00/0xcbad34b281572066 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.972448:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003d8c7f00/0xcbad34b281572066 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.972455:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003d8c7f00/0xcbad34b281572066 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.972476:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710968.972478:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710968.972480:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790710968.972927:0:16041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790710968.972934:0:16041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a6174e4/0xcbad34b28157206d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.972945:0:16041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=446s v=(0 0) 00010000:00010000:0.0:1790710968.972949:0:16041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790710968.972953:0:16041:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a6174e4/0xcbad34b28157206d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.972962:0:16041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a6174e4/0xcbad34b28157206d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.972970:0:16041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a6174e4/0xcbad34b28157206d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.972984:0:16041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a6174e4/0xcbad34b28157206d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.973001:0:16041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790710968.973011:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790710968.973015:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a6174e4/0xcbad34b28157206d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.973022:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c0030400 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:0.0:1790710968.973026:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a6174e4/0xcbad34b28157206d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.973033:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a6174e4/0xcbad34b28157206d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.973044:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a6174e4/0xcbad34b28157206d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.973052:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a6174e4/0xcbad34b28157206d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.973068:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790710968.973070:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790710968.973071:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790710968.973700:0:16041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790710968.973715:0:16041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051061c53/0xcbad34b281572074 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.973724:0:16041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=446s v=(0 0) 00010000:00010000:0.0:1790710968.973728:0:16041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790710968.973732:0:16041:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051061c53/0xcbad34b281572074 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.973741:0:16041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051061c53/0xcbad34b281572074 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.973749:0:16041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051061c53/0xcbad34b281572074 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.973756:0:16041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000051061c53/0xcbad34b281572074 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.973770:0:16041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790710968.973780:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790710968.973784:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000051061c53/0xcbad34b281572074 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.973790:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c0031000 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:0.0:1790710968.973793:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000051061c53/0xcbad34b281572074 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.973800:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000051061c53/0xcbad34b281572074 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.973817:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000051061c53/0xcbad34b281572074 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.973823:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051061c53/0xcbad34b281572074 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.973838:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790710968.973839:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790710968.973841:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790710968.974458:0:16041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790710968.974466:0:16041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed8d8e52/0xcbad34b28157207b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.974475:0:16041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=446s v=(0 0) 00010000:00010000:0.0:1790710968.974479:0:16041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790710968.974483:0:16041:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed8d8e52/0xcbad34b28157207b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.974492:0:16041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed8d8e52/0xcbad34b28157207b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.974501:0:16041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed8d8e52/0xcbad34b28157207b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.974509:0:16041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ed8d8e52/0xcbad34b28157207b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.974540:0:16041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790710968.974551:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790710968.974556:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ed8d8e52/0xcbad34b28157207b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.974562:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c0031600 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:0.0:1790710968.974566:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed8d8e52/0xcbad34b28157207b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.974575:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed8d8e52/0xcbad34b28157207b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.974587:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ed8d8e52/0xcbad34b28157207b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.974594:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed8d8e52/0xcbad34b28157207b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710968.974609:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790710968.974611:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790710968.974613:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1790710968.974858:0:16041:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:0.0:1790710968.974948:0:16041:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c50c35b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14487:x1877696177078528:12345-0@lo:5:osp-pre-0-0.0 Request processed in 64551us (64789us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710968.974958:0:16041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00002000:00010000:3.0:1790710968.974989:0:15149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790710968.974997:0:15149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d35a299c/0xcbad34b281572082 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710968.975007:0:15149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=446s v=(0 0) 00010000:00010000:3.0:1790710968.975011:0:15149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790710968.975015:0:15149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d35a299c/0xcbad34b281572082 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710968.975022:0:14487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c50c35b2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14487:1877696177078528:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1790710968.975037:0:14487:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:0.0:1790710968.975079:0:14487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c50c35b2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14487:1877696177078912:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1790710968.975114:0:14487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790710968.975184:0:15149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d35a299c/0xcbad34b281572082 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710968.975193:0:15149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d35a299c/0xcbad34b281572082 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710968.975199:0:15149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d35a299c/0xcbad34b281572082 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710968.975212:0:15149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1790710968.975448:0:14487:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51d8a96480 going to sleep for 11 seconds 00000100:00100000:0.0:1790710968.975467:0:15148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177078912 00000100:00100000:0.0:1790710968.975474:0:15148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177078912 00000100:00100000:0.0:1790710968.975514:0:15148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790710968.975523:0:15148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c50c35b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14487:x1877696177078912:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1790710968.975562:0:15148:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00002000:00010000:3.0:1790710968.975689:0:15149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790710968.975696:0:15149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068803ad0/0xcbad34b281572089 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710968.975712:0:15149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=446s v=(0 0) 00010000:00010000:3.0:1790710968.975716:0:15149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790710968.975721:0:15149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068803ad0/0xcbad34b281572089 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710968.975731:0:15149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000068803ad0/0xcbad34b281572089 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710968.975740:0:15149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068803ad0/0xcbad34b281572089 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710968.975748:0:15149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000068803ad0/0xcbad34b281572089 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710968.975758:0:15149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1790710968.976230:0:15149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790710968.976237:0:15149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5746385/0xcbad34b281572090 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710968.976247:0:15149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=446s v=(0 0) 00010000:00010000:3.0:1790710968.976250:0:15149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790710968.976254:0:15149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b5746385/0xcbad34b281572090 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710968.976263:0:15149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b5746385/0xcbad34b281572090 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710968.976282:0:15149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5746385/0xcbad34b281572090 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710968.976289:0:15149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b5746385/0xcbad34b281572090 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710968.976298:0:15149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1790710968.976761:0:15149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790710968.976768:0:15149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000995c8353/0xcbad34b281572097 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710968.976777:0:15149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=446s v=(0 0) 00010000:00010000:3.0:1790710968.976781:0:15149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790710968.976785:0:15149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000995c8353/0xcbad34b281572097 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710968.976795:0:15149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000995c8353/0xcbad34b281572097 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710968.976803:0:15149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000995c8353/0xcbad34b281572097 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710968.976811:0:15149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000995c8353/0xcbad34b281572097 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710968.976831:0:15149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1790710968.977372:0:15149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790710968.977379:0:15149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068661c21/0xcbad34b28157209e lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710968.977387:0:15149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=446s v=(0 0) 00010000:00010000:3.0:1790710968.977390:0:15149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790710968.977395:0:15149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068661c21/0xcbad34b28157209e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710968.977404:0:15149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000068661c21/0xcbad34b28157209e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710968.977412:0:15149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068661c21/0xcbad34b28157209e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710968.977420:0:15149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000068661c21/0xcbad34b28157209e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710968.977429:0:15149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:1.0:1790710968.977966:0:16043:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1790710968.977974:0:16043:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d35a299c/0xcbad34b281572082 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.977989:0:16043:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c8047800 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:1.0:1790710968.977994:0:16043:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d35a299c/0xcbad34b281572082 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.978005:0:16043:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d35a299c/0xcbad34b281572082 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.978331:0:16043:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d35a299c/0xcbad34b281572082 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.978340:0:16043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d35a299c/0xcbad34b281572082 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.978363:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b271cda/0xcbad34b28157202e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790710968.978371:0:15149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790710968.978371:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c8046800 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:1.0:1790710968.978375:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b271cda/0xcbad34b28157202e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710968.978377:0:15149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5d5eeb4/0xcbad34b2815720a5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.978383:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b271cda/0xcbad34b28157202e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710968.978386:0:15149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1790710968.978393:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b271cda/0xcbad34b28157202e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710968.978394:0:15149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790710968.978399:0:15149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5d5eeb4/0xcbad34b2815720a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.978409:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b271cda/0xcbad34b28157202e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710968.978410:0:15149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5d5eeb4/0xcbad34b2815720a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710968.978419:0:15149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5d5eeb4/0xcbad34b2815720a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.978425:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1790710968.978426:0:15149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5d5eeb4/0xcbad34b2815720a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.978428:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000068803ad0/0xcbad34b281572089 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710968.978435:0:15149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:1.0:1790710968.978435:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c8046a00 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:1.0:1790710968.978438:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000068803ad0/0xcbad34b281572089 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.978445:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000068803ad0/0xcbad34b281572089 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.978454:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000068803ad0/0xcbad34b281572089 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.978461:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068803ad0/0xcbad34b281572089 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.978479:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1790710968.978482:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b5746385/0xcbad34b281572090 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.978488:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c8047000 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:1.0:1790710968.978496:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5746385/0xcbad34b281572090 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.978505:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5746385/0xcbad34b281572090 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.978516:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b5746385/0xcbad34b281572090 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.978523:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b5746385/0xcbad34b281572090 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.978537:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1790710968.978540:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000995c8353/0xcbad34b281572097 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.978546:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c8047a00 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:1.0:1790710968.978549:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000995c8353/0xcbad34b281572097 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.978557:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000995c8353/0xcbad34b281572097 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.978570:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000995c8353/0xcbad34b281572097 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.978578:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000995c8353/0xcbad34b281572097 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.978675:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790710968.978679:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000068661c21/0xcbad34b28157209e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.978686:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c8047600 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:1.0:1790710968.978690:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000068661c21/0xcbad34b28157209e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.978698:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000068661c21/0xcbad34b28157209e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.978709:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000068661c21/0xcbad34b28157209e lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.978715:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068661c21/0xcbad34b28157209e lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.978728:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790710968.978731:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5d5eeb4/0xcbad34b2815720a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.978736:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c1644c00 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:1.0:1790710968.978740:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5d5eeb4/0xcbad34b2815720a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.978828:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5d5eeb4/0xcbad34b2815720a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.978841:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5d5eeb4/0xcbad34b2815720a5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.978848:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5d5eeb4/0xcbad34b2815720a5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.978864:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790710968.978866:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790710968.978868:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790710968.978876:0:16043:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790710968.978879:0:16043:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790710968.978882:0:16043:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790710968.978918:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790710968.979549:0:15149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790710968.979557:0:15149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068ec192d/0xcbad34b2815720ac lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710968.979634:0:15149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=446s v=(0 0) 00010000:00010000:3.0:1790710968.979639:0:15149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790710968.979644:0:15149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068ec192d/0xcbad34b2815720ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710968.979655:0:15149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000068ec192d/0xcbad34b2815720ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710968.979664:0:15149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068ec192d/0xcbad34b2815720ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710968.979677:0:15149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000068ec192d/0xcbad34b2815720ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710968.979697:0:15149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790710968.979703:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790710968.979708:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000068ec192d/0xcbad34b2815720ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.979715:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c1645a00 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:1.0:1790710968.979719:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000068ec192d/0xcbad34b2815720ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.979727:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000068ec192d/0xcbad34b2815720ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.979748:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000068ec192d/0xcbad34b2815720ac lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.979827:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068ec192d/0xcbad34b2815720ac lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710968.979844:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790710968.979846:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790710968.979849:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790710968.980309:0:15149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790710968.980317:0:15149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059d14e85/0xcbad34b2815720b3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710968.980326:0:15149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=446s v=(0 0) 00010000:00010000:3.0:1790710968.980330:0:15149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790710968.980335:0:15149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059d14e85/0xcbad34b2815720b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710968.980345:0:15149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000059d14e85/0xcbad34b2815720b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710968.980353:0:15149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059d14e85/0xcbad34b2815720b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710968.980360:0:15149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000059d14e85/0xcbad34b2815720b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710968.980427:0:15149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1790710968.980812:0:15149:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:3.0:1790710968.980911:0:15149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff87e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14489:x1877696177078784:12345-0@lo:5:osp-pre-1-0.0 Request processed in 67606us (67820us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710968.980928:0:15149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790710968.981016:0:14489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51ff87ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14489:1877696177078784:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1790710968.981089:0:14489:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:1.0:1790710968.981151:0:14489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51ff87ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14489:1877696177079040:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1790710968.981186:0:14489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710968.981215:0:14489:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c5f57840 going to sleep for 11 seconds 00000100:00100000:1.0:1790710968.981300:0:15150:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177079040 00000100:00100000:1.0:1790710968.981307:0:15150:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177079040 00000100:00100000:1.0:1790710968.981345:0:15150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790710968.981355:0:15150:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff87d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14489:x1877696177079040:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1790710968.981391:0:15150:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:2.0:1790710968.983323:0:16043:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790710968.983334:0:16043:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000059d14e85/0xcbad34b2815720b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.983345:0:16043:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c1644e00 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:2.0:1790710968.983350:0:16043:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000059d14e85/0xcbad34b2815720b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.983360:0:16043:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000059d14e85/0xcbad34b2815720b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.983378:0:16043:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000059d14e85/0xcbad34b2815720b3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710968.983386:0:16043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059d14e85/0xcbad34b2815720b3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710968.984025:0:16043:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790710968.984029:0:16043:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790710968.984032:0:16043:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790710968.984365:0:15148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c50c35b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14487:x1877696177078912:12345-0@lo:5:osp-pre-0-0.0 Request processed in 8840us (9247us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1790710968.984378:0:15148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790710968.984502:0:14487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c50c35b2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14487:1877696177078912:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1790710968.984518:0:14487:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00000100:00100000:1.0:1790710968.989534:0:15150:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff87d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14489:x1877696177079040:12345-0@lo:5:osp-pre-1-0.0 Request processed in 8175us (8341us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1790710968.989546:0:15150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790710968.989734:0:14489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51ff87ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14489:1877696177079040:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1790710968.989749:0:14489:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000004:00080000:3.0:1790710969.002317:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:3.0:1790710969.479928:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1790710969.754499:0:6720:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:2.0:1790710969.754568:0:6720:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1790710970.503417:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1790710971.263230:0:7643:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:3.0:1790710971.263278:0:7643:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1790710971.527911:0:16043:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1790710971.978091:0:16227:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg646-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1790710972.561067:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790710973.577445:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790710974.215628:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c50c35b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177079168:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790710974.215695:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710974.215872:0:15151:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177079168 00000100:00100000:3.0:1790710974.215878:0:15151:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177079168 00000100:00100000:3.0:1790710974.215930:0:15151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790710974.215940:0:15151:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c50c35b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877696177079168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790710974.215973:0:15151:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790710974.216018:0:15151:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c50c35b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877696177079168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710974.216025:0:15151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1790710974.216047:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790710974.216341:0:3311:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1790710974.216361:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c50c35b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177079168:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790710974.216375:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790710974.216380:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c75dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177079296:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790710974.216407:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710974.216491:0:15151:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177079296 00000100:00100000:3.0:1790710974.216496:0:15151:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177079296 00000100:00100000:3.0:1790710974.216539:0:15151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790710974.216547:0:15151:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c75ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877696177079296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790710974.216566:0:15151:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790710974.216607:0:15151:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c75ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877696177079296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710974.216613:0:15151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1790710974.216630:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790710974.216703:0:3311:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1790710974.216717:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c75dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177079296:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790710974.217921:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790710974.217937:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51ff87fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:3310:1877696177079424:0@lo:400:kworker.0 00000100:00100000:0.0:1790710974.217990:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710974.218087:0:14459:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177079424 00000100:00100000:2.0:1790710974.218105:0:14459:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177079424 00000100:00100000:2.0:1790710974.218185:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1790710974.218193:0:14459:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f3d54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+19:3310:x1877696177079424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790710974.218246:0:14459:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f3d54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+19:3310:x1877696177079424:12345-0@lo:400:kworker.0 Request processed in 53us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710974.218254:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1790710974.218306:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51ff87fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:3310:1877696177079424:0@lo:400:kworker.0 00000100:00100000:1.0:1790710974.218547:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51ff87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1877696177079808:0@lo:400:kworker.0 00000100:00100000:1.0:1790710974.218583:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710974.218791:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51ff87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877696177079552:0@lo:400:kworker.0 00000100:00100000:2.0:1790710974.219116:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51ff87ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1877696177079680:0@lo:400:kworker.0 00000100:00100000:0.0:1790710974.219233:0:14466:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177079808 00000100:00100000:0.0:1790710974.219238:0:14466:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177079808 00000100:00100000:0.0:1790710974.219274:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790710974.219285:0:14464:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1790710974.219289:0:14466:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff87d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1877696177079808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790710974.219292:0:14464:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1790710974.219334:0:14466:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff87d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1877696177079808:12345-0@lo:400:kworker.0 Request processed in 46us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710974.219339:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1790710974.219378:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51ff87c700 x1877696177079808/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790710990 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790710974.219403:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51ff87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1877696177079808:0@lo:400:kworker.0 00000100:00100000:2.0:1790710974.219468:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710974.219538:0:14465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177079680 00000100:00100000:0.0:1790710974.219543:0:14465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177079680 00000100:00100000:0.0:1790710974.219624:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790710974.219632:0:14465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1877696177079680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790710974.219669:0:14465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1877696177079680:12345-0@lo:400:kworker.0 Request processed in 38us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710974.219675:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1790710974.219783:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790710974.219795:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710974.220121:0:14466:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177079552 00000100:00100000:2.0:1790710974.220145:0:14466:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177079552 00000100:00100000:2.0:1790710974.220166:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790710974.220171:0:14466:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c75dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1877696177079552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790710974.220205:0:14466:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c75dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1877696177079552:12345-0@lo:400:kworker.0 Request processed in 33us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710974.220210:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1790710974.220237:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51ff87ce00 x1877696177079680/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790710990 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790710974.220246:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51ff87ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1877696177079680:0@lo:400:kworker.0 00010000:00080000:2.0:1790710974.220277:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c51ff87df80 x1877696177079552/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790710990 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790710974.220284:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51ff87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877696177079552:0@lo:400:kworker.0 00000100:00100000:2.0:1790710974.237745:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710974.238198:0:14458:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158211328 00000100:00100000:0.0:1790710974.238208:0:14458:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158211328 00000100:00100000:0.0:1790710974.238254:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 75 00000100:00100000:0.0:1790710974.238262:0:14458:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f3d56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2355:x1877696158211328:12345-192.168.206.46@tcp:250:mount.lustre.0 00010000:00080000:0.0:1790710974.238288:0:14458:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 0b5b9c20-4564-43be-9f40-bd916384ea36@192.168.206.46@tcp t0 exp 0000000000000000 cur 451 last 0 00000020:00000080:0.0:1790710974.239182:0:14458:0:(genops.c:1384:class_connect()) connect: client 0b5b9c20-4564-43be-9f40-bd916384ea36, cookie 0xcbad34b2815720ba 00000100:00080000:0.0:1790710974.239362:0:14458:0:(import.c:65:import_set_state_nolock()) ffff9c51f3c34000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790710974.239740:0:14458:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f3d56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b5b9c20-4564-43be-9f40-bd916384ea36+5:2355:x1877696158211328:12345-192.168.206.46@tcp:250:mount.lustre.0 Request processed in 1475us (2001us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710974.239749:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 75 00000100:00100000:0.0:1790710974.246659:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710974.250393:0:14457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158211456 00000100:00100000:2.0:1790710974.250408:0:14457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158211456 00000100:00100000:2.0:1790710974.250521:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 76 00000100:00100000:2.0:1790710974.250533:0:14457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f3d57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b5b9c20-4564-43be-9f40-bd916384ea36+5:13725:x1877696158211456:12345-192.168.206.46@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790710974.250551:0:14457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790710974.250583:0:14457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c51f43f9200/0xcbad34b2815720c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x566877b0570007d5 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710974.250622:0:14457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c51f43f9200/0xcbad34b2815720c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570007d5 expref: 6 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710974.250634:0:14457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c51f43f9200/0xcbad34b2815720c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570007d5 expref: 6 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710974.250642:0:14457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51f43f9200, rc 0) 00000100:00100000:2.0:1790710974.250712:0:14457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f3d57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b5b9c20-4564-43be-9f40-bd916384ea36+6:13725:x1877696158211456:12345-192.168.206.46@tcp:101:mount.lustre.0 Request processed in 181us (4063us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710974.250720:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 76 00000100:00100000:2.0:1790710974.256760:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710974.257555:0:14458:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158211584 00000100:00100000:0.0:1790710974.257566:0:14458:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158211584 00000100:00100000:0.0:1790710974.257639:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 77 00000100:00100000:0.0:1790710974.257647:0:14458:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f3d56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b5b9c20-4564-43be-9f40-bd916384ea36+6:13725:x1877696158211584:12345-192.168.206.46@tcp:501:mount.lustre.0 00000100:00100000:0.0:1790710974.258163:0:14458:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f3d56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b5b9c20-4564-43be-9f40-bd916384ea36+6:13725:x1877696158211584:12345-192.168.206.46@tcp:501:mount.lustre.0 Request processed in 477us (1373us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790710974.258174:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 77 00000100:00100000:3.0:1790710974.262888:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710974.262988:0:14457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158211712 00000100:00100000:2.0:1790710974.262999:0:14457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158211712 00000100:00100000:2.0:1790710974.263058:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 78 00000100:00100000:2.0:1790710974.263067:0:14457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f3d57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b5b9c20-4564-43be-9f40-bd916384ea36+6:13725:x1877696158211712:12345-192.168.206.46@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790710974.263084:0:14457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790710974.263100:0:14457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c51f43f8e00/0xcbad34b2815720c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x566877b0570007dc expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710974.263172:0:14457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c51f43f8e00/0xcbad34b2815720c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570007dc expref: 7 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710974.263196:0:14457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c51f43f8e00/0xcbad34b2815720c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570007dc expref: 7 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710974.263205:0:14457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51f43f8e00, rc 0) 00000100:00100000:2.0:1790710974.263272:0:14457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f3d57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b5b9c20-4564-43be-9f40-bd916384ea36+7:13725:x1877696158211712:12345-192.168.206.46@tcp:101:mount.lustre.0 Request processed in 205us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710974.263279:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 78 00000100:00100000:1.0:1790710974.265302:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710974.265547:0:14459:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158211840 00000100:00100000:2.0:1790710974.265555:0:14459:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158211840 00000100:00100000:2.0:1790710974.265687:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 79 00000100:00100000:2.0:1790710974.265696:0:14459:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f3d55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b5b9c20-4564-43be-9f40-bd916384ea36+7:13725:x1877696158211840:12345-192.168.206.46@tcp:501:mount.lustre.0 00000100:00100000:2.0:1790710974.265974:0:14459:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f3d55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b5b9c20-4564-43be-9f40-bd916384ea36+8:13725:x1877696158211840:12345-192.168.206.46@tcp:501:mount.lustre.0 Request processed in 277us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710974.265981:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 79 00000100:00100000:3.0:1790710974.268661:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710974.272404:0:14458:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158211968 00000100:00100000:0.0:1790710974.272419:0:14458:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158211968 00000100:00100000:0.0:1790710974.272553:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 80 00000100:00100000:0.0:1790710974.272563:0:14458:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4765450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b5b9c20-4564-43be-9f40-bd916384ea36+8:13725:x1877696158211968:12345-192.168.206.46@tcp:503:mount.lustre.0 00000100:00100000:0.0:1790710974.273014:0:14458:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4765450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b5b9c20-4564-43be-9f40-bd916384ea36+8:13725:x1877696158211968:12345-192.168.206.46@tcp:503:mount.lustre.0 Request processed in 450us (4360us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710974.273022:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 80 00000100:00100000:2.0:1790710974.281813:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710974.282994:0:14457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158212096 00000100:00100000:0.0:1790710974.283007:0:14457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158212096 00000100:00100000:0.0:1790710974.283053:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 81 00000100:00100000:0.0:1790710974.283062:0:14457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4764c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b5b9c20-4564-43be-9f40-bd916384ea36+8:13743:x1877696158212096:12345-192.168.206.46@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790710974.283862:0:14457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4764c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b5b9c20-4564-43be-9f40-bd916384ea36+8:13743:x1877696158212096:12345-192.168.206.46@tcp:502:llog_process_th.0 Request processed in 795us (2052us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710974.283874:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 81 00000100:00100000:1.0:1790710974.327663:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710974.327755:0:14459:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158212224 00000100:00100000:2.0:1790710974.327764:0:14459:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158212224 00000100:00100000:2.0:1790710974.327817:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 82 00000100:00100000:2.0:1790710974.327825:0:14459:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4764050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b5b9c20-4564-43be-9f40-bd916384ea36+8:13743:x1877696158212224:12345-192.168.206.46@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790710974.328084:0:14459:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4764050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b5b9c20-4564-43be-9f40-bd916384ea36+8:13743:x1877696158212224:12345-192.168.206.46@tcp:502:llog_process_th.0 Request processed in 258us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710974.328092:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 82 00000100:00100000:3.0:1790710974.332720:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710974.333056:0:14458:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158212352 00000100:00100000:1.0:1790710974.333066:0:14458:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158212352 00000100:00100000:1.0:1790710974.333121:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 83 00000100:00100000:1.0:1790710974.333171:0:14458:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4765c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b5b9c20-4564-43be-9f40-bd916384ea36+8:13725:x1877696158212352:12345-192.168.206.46@tcp:101:mount.lustre.0 00010000:00010000:1.0:1790710974.333187:0:14458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790710974.333203:0:14458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c51ff134600/0xcbad34b2815720cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x566877b057000806 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710974.333241:0:14458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c51ff134600/0xcbad34b2815720cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000806 expref: 9 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710974.333252:0:14458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c51ff134600/0xcbad34b2815720cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000806 expref: 9 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710974.333261:0:14458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51ff134600, rc 0) 00000100:00100000:1.0:1790710974.333312:0:14458:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4765c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b5b9c20-4564-43be-9f40-bd916384ea36+9:13725:x1877696158212352:12345-192.168.206.46@tcp:101:mount.lustre.0 Request processed in 144us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710974.333319:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 83 00000100:00100000:3.0:1790710974.339957:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710974.340065:0:14457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158212480 00000100:00100000:0.0:1790710974.340075:0:14457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158212480 00000100:00100000:0.0:1790710974.340165:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 84 00000100:00100000:0.0:1790710974.340174:0:14457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4767850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b5b9c20-4564-43be-9f40-bd916384ea36+9:13725:x1877696158212480:12345-192.168.206.46@tcp:256:mount.lustre.0 20000000:01000000:0.0:1790710974.340223:0:14457:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1790710974.340239:0:14457:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1790710974.340243:0:14457:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1790710974.340245:0:14457:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1790710974.340247:0:14457:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1790710974.342424:0:14457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4767850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b5b9c20-4564-43be-9f40-bd916384ea36+9:13725:x1877696158212480:12345-192.168.206.46@tcp:256:mount.lustre.0 Request processed in 2243us (2468us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710974.342456:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 84 00000100:00100000:3.0:1790710974.345402:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710974.345989:0:14459:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158212608 00000100:00100000:2.0:1790710974.345998:0:14459:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158212608 00000100:00100000:2.0:1790710974.346055:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 85 00000100:00100000:2.0:1790710974.346064:0:14459:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4765050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b5b9c20-4564-43be-9f40-bd916384ea36+9:13725:x1877696158212608:12345-192.168.206.46@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790710974.346080:0:14459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790710974.346096:0:14459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c51f43f8200/0xcbad34b2815720d6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x566877b05700080d expref: -99 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710974.346122:0:14459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c51f43f8200/0xcbad34b2815720d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700080d expref: 10 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710974.346183:0:14459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c51f43f8200/0xcbad34b2815720d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700080d expref: 10 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710974.346192:0:14459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51f43f8200, rc 0) 00000100:00100000:2.0:1790710974.346252:0:14459:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4765050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b5b9c20-4564-43be-9f40-bd916384ea36+10:13725:x1877696158212608:12345-192.168.206.46@tcp:101:mount.lustre.0 Request processed in 189us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710974.346259:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 85 00000100:00100000:3.0:1790710974.350951:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710974.351315:0:14457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158212736 00000100:00100000:2.0:1790710974.351339:0:14457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158212736 00000100:00100000:2.0:1790710974.351397:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 86 00000100:00100000:2.0:1790710974.351407:0:14457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4765850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b5b9c20-4564-43be-9f40-bd916384ea36+10:13725:x1877696158212736:12345-192.168.206.46@tcp:501:mount.lustre.0 00000100:00100000:2.0:1790710974.351699:0:14457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4765850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b5b9c20-4564-43be-9f40-bd916384ea36+10:13725:x1877696158212736:12345-192.168.206.46@tcp:501:mount.lustre.0 Request processed in 292us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710974.351707:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 86 00000100:00100000:0.0:1790710974.355881:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710974.356073:0:14458:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158212864 00000100:00100000:1.0:1790710974.356082:0:14458:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158212864 00000100:00100000:1.0:1790710974.356165:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 87 00000100:00100000:1.0:1790710974.356175:0:14458:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4766850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b5b9c20-4564-43be-9f40-bd916384ea36+10:13725:x1877696158212864:12345-192.168.206.46@tcp:503:mount.lustre.0 00000100:00100000:1.0:1790710974.356699:0:14458:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4766850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b5b9c20-4564-43be-9f40-bd916384ea36+10:13725:x1877696158212864:12345-192.168.206.46@tcp:503:mount.lustre.0 Request processed in 523us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710974.356716:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 87 00000100:00100000:3.0:1790710974.360715:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710974.360822:0:14459:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158212992 00000100:00100000:0.0:1790710974.360832:0:14459:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158212992 00000100:00100000:0.0:1790710974.360892:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 88 00000100:00100000:0.0:1790710974.360901:0:14459:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c529fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b5b9c20-4564-43be-9f40-bd916384ea36+10:13748:x1877696158212992:12345-192.168.206.46@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790710974.361569:0:14459:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c529fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b5b9c20-4564-43be-9f40-bd916384ea36+10:13748:x1877696158212992:12345-192.168.206.46@tcp:502:llog_process_th.0 Request processed in 665us (857us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710974.361579:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 88 00000100:00100000:2.0:1790710974.370512:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710974.371345:0:14457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158213120 00000100:00100000:0.0:1790710974.371356:0:14457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158213120 00000100:00100000:0.0:1790710974.371412:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 89 00000100:00100000:0.0:1790710974.371421:0:14457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c529f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b5b9c20-4564-43be-9f40-bd916384ea36+10:13748:x1877696158213120:12345-192.168.206.46@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790710974.371663:0:14457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c529f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b5b9c20-4564-43be-9f40-bd916384ea36+10:13748:x1877696158213120:12345-192.168.206.46@tcp:502:llog_process_th.0 Request processed in 242us (1158us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710974.371671:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 89 00000100:00100000:2.0:1790710974.382381:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710974.383919:0:14466:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158213248 00000100:00100000:0.0:1790710974.383940:0:14466:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158213248 00000100:00100000:0.0:1790710974.383986:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 4 00000100:00100000:0.0:1790710974.383995:0:14466:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2355:x1877696158213248:12345-192.168.206.46@tcp:38:mount.lustre.0 00010000:00080000:0.0:1790710974.384020:0:14466:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 07f3a30d-977e-4e8f-a2f1-7a826af5c45b@192.168.206.46@tcp t0 exp 0000000000000000 cur 451 last 0 00000020:00000080:0.0:1790710974.384075:0:14466:0:(genops.c:1384:class_connect()) connect: client 07f3a30d-977e-4e8f-a2f1-7a826af5c45b, cookie 0xcbad34b2815720dd 00000004:00100000:0.0:1790710974.384101:0:14466:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1790710974.384106:0:14466:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:0.0:1790710974.422180:0:14466:0:(import.c:65:import_set_state_nolock()) ffff9c51f3c31800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790710974.422450:0:14466:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+6:2355:x1877696158213248:12345-192.168.206.46@tcp:38:mount.lustre.0 Request processed in 38444us (40067us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710974.422461:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 4 00000100:00100000:2.0:1790710974.427907:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710974.427952:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710974.428031:0:16341:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158213376 00000100:00100000:1.0:1790710974.428040:0:16341:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158213376 00000100:00100000:1.0:1790710974.429609:0:16341:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158213504 00000100:00100000:1.0:1790710974.429618:0:16341:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158213504 00000100:00100000:1.0:1790710974.429653:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 5 00000100:00100000:1.0:1790710974.429662:0:14466:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+7:0:x1877696158213376:12345-192.168.206.46@tcp:41:mount.lustre.0 00000004:00000024:1.0:1790710974.429701:0:14466:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1790710974.429777:0:14466:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+7:0:x1877696158213376:12345-192.168.206.46@tcp:41:mount.lustre.0 Request processed in 116us (1878us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710974.429783:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 5 00000100:00100000:1.0:1790710974.429801:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 6 00000100:00100000:1.0:1790710974.429806:0:14466:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+6:13725:x1877696158213504:12345-192.168.206.46@tcp:41:mount.lustre.0 00000004:00000024:1.0:1790710974.429816:0:14466:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1790710974.429833:0:14466:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+6:13725:x1877696158213504:12345-192.168.206.46@tcp:41:mount.lustre.0 Request processed in 27us (1881us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710974.429838:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 6 00000100:00080000:0.0:1790710974.430526:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790710974.432679:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710974.432767:0:14466:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158213632 00000100:00100000:1.0:1790710974.432776:0:14466:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158213632 00000100:00100000:1.0:1790710974.432824:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 7 00000100:00100000:1.0:1790710974.432832:0:14466:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+6:13725:x1877696158213632:12345-192.168.206.46@tcp:40:mount.lustre.0 00000100:00100000:1.0:1790710974.432905:0:14466:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+6:13725:x1877696158213632:12345-192.168.206.46@tcp:40:mount.lustre.0 Request processed in 74us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710974.432924:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 7 00000100:00100000:1.0:1790710974.437611:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710974.437703:0:15149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158213760 00000100:00100000:3.0:1790710974.437712:0:15149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158213760 00000100:00100000:3.0:1790710974.437760:0:15149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 6 00000100:00100000:3.0:1790710974.437768:0:15149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff87df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2355:x1877696158213760:12345-192.168.206.46@tcp:8:mount.lustre.0 00010000:00080000:3.0:1790710974.437799:0:15149:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 07f3a30d-977e-4e8f-a2f1-7a826af5c45b@192.168.206.46@tcp t0 exp 0000000000000000 cur 451 last 0 00000020:00000080:3.0:1790710974.437828:0:15149:0:(genops.c:1384:class_connect()) connect: client 07f3a30d-977e-4e8f-a2f1-7a826af5c45b, cookie 0xcbad34b2815720e4 00002000:00100000:3.0:1790710974.437840:0:15149:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 07f3a30d-977e-4e8f-a2f1-7a826af5c45b/ffff9c51c6525800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1790710974.437851:0:15149:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1790710974.438228:0:15149:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1790710974.438258:0:15149:0:(import.c:65:import_set_state_nolock()) ffff9c51c6524000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790710974.438395:0:15149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff87df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+6:2355:x1877696158213760:12345-192.168.206.46@tcp:8:mount.lustre.0 Request processed in 626us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710974.438404:0:15149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 6 00000100:00100000:2.0:1790710974.446425:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710974.446563:0:15148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158213888 00000100:00100000:0.0:1790710974.446573:0:15148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158213888 00000100:00100000:0.0:1790710974.446637:0:15148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 7 00000100:00100000:0.0:1790710974.446645:0:15148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2355:x1877696158213888:12345-192.168.206.46@tcp:8:mount.lustre.0 00010000:00080000:0.0:1790710974.446678:0:15148:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 07f3a30d-977e-4e8f-a2f1-7a826af5c45b@192.168.206.46@tcp t0 exp 0000000000000000 cur 451 last 0 00000020:00000080:0.0:1790710974.446709:0:15148:0:(genops.c:1384:class_connect()) connect: client 07f3a30d-977e-4e8f-a2f1-7a826af5c45b, cookie 0xcbad34b2815720eb 00002000:00100000:0.0:1790710974.446720:0:15148:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 07f3a30d-977e-4e8f-a2f1-7a826af5c45b/ffff9c51f3c32800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790710974.446731:0:15148:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1790710974.447070:0:15148:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1790710974.453659:0:15148:0:(import.c:65:import_set_state_nolock()) ffff9c51c3e7c800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790710974.453750:0:15148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+6:2355:x1877696158213888:12345-192.168.206.46@tcp:8:mount.lustre.0 Request processed in 7100us (7330us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710974.453761:0:15148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 7 00000100:00100000:2.0:1790710974.454621:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710974.454659:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710974.454682:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710974.454782:0:14459:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158214144 00000100:00100000:0.0:1790710974.454791:0:14459:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158214144 00000100:00100000:0.0:1790710974.454849:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 90 00000100:00100000:0.0:1790710974.454859:0:14459:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c529cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b5b9c20-4564-43be-9f40-bd916384ea36+10:2356:x1877696158214144:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:0.0:1790710974.454917:0:14459:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c529cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b5b9c20-4564-43be-9f40-bd916384ea36+10:2356:x1877696158214144:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 60us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710974.454924:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 90 00000100:00100000:1.0:1790710974.455066:0:14467:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158214016 00000100:00100000:1.0:1790710974.455071:0:14467:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158214016 00000100:00100000:1.0:1790710974.455115:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 0 00000100:00100000:1.0:1790710974.455122:0:14467:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+6:13725:x1877696158214016:12345-192.168.206.46@tcp:33:mount.lustre.0 00000004:00080000:1.0:1790710974.455753:0:14467:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 562us 00000100:00100000:2.0:1790710974.457554:0:14464:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158214272 00000100:00100000:2.0:1790710974.457567:0:14464:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158214272 00000100:00100000:2.0:1790710974.457643:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 13 00000100:00100000:2.0:1790710974.457652:0:14464:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+7:2356:x1877696158214272:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:2.0:1790710974.457722:0:14464:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+7:2356:x1877696158214272:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 70us (3037us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710974.457729:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 13 00000004:00200000:2.0:1790710974.477918:0:14467:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1790710974.478037:0:14467:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+6:13725:x1877696158214016:12345-192.168.206.46@tcp:33:mount.lustre.0 Request processed in 22909us (23414us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710974.478051:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 0 00010000:00010000:3.0:1790710974.601232:0:16043:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790710974.645369:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710974.645497:0:14466:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158214400 00000100:00100000:1.0:1790710974.645510:0:14466:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158214400 00000100:00100000:1.0:1790710974.645581:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 8 00000100:00100000:1.0:1790710974.645601:0:14466:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8e8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+6:13770:x1877696158214400:12345-192.168.206.46@tcp:101:mkdir.0 00010000:00010000:1.0:1790710974.645628:0:14466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790710974.645660:0:14466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ff135400/0xcbad34b2815720f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b057000837 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710974.645759:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ff134000/0xcbad34b2815720f9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710974.645775:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ff134000/0xcbad34b2815720f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710974.645792:0:14466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ff134000/0xcbad34b2815720f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790710974.645854:0:14466:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1790710974.645858:0:14466:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790710974.645901:0:14466:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ff134000/0xcbad34b2815720f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710974.645931:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ff135400/0xcbad34b2815720f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000837 expref: 8 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710974.645953:0:14466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ff134000/0xcbad34b2815720f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000837 expref: 7 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710974.645963:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c51d8e33400) 00010000:00010000:1.0:1790710974.645966:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790710974.645970:0:14466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51ff134000, rc 0) 00000100:00100000:1.0:1790710974.646049:0:14466:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8e8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+7:13770:x1877696158214400:12345-192.168.206.46@tcp:101:mkdir.0 Request processed in 458us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710974.646057:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 8 00000001:00100000:1.0:1790710974.831933:0:6720:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 07f3a30d-977e-4e8f-a2f1-7a826af5c45b 00010000:00010000:0.0:1790710975.625287:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790710975.944618:0:14496:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:3.0:1790710976.411593:0:7643:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 07f3a30d-977e-4e8f-a2f1-7a826af5c45b 00010000:00010000:3.0:1790710976.648269:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790710976.697359:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710976.697780:0:14464:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158214528 00000100:00100000:2.0:1790710976.697793:0:14464:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158214528 00000100:00100000:2.0:1790710976.697888:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 9 00000100:00100000:2.0:1790710976.697910:0:14464:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c50c35b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+7:13822:x1877696158214528:12345-192.168.206.46@tcp:41:lfs.0 00000004:00000024:2.0:1790710976.697968:0:14464:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1790710976.698110:0:14464:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c50c35b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+7:13822:x1877696158214528:12345-192.168.206.46@tcp:41:lfs.0 Request processed in 203us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710976.698120:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 9 00000100:00080000:0.0:1790710976.698746:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790710976.706064:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710976.706369:0:15151:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158214656 00000100:00100000:0.0:1790710976.706385:0:15151:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158214656 00000100:00100000:0.0:1790710976.706498:0:15151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 4 00000100:00100000:0.0:1790710976.706511:0:15151:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c75dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+5:13822:x1877696158214656:12345-192.168.206.46@tcp:13:lfs.0 00002000:00000024:0.0:1790710976.706566:0:15151:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790710976.706692:0:15151:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c75dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+5:13822:x1877696158214656:12345-192.168.206.46@tcp:13:lfs.0 Request processed in 183us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710976.706700:0:15151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 4 00000100:00080000:3.0:1790710976.707658:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790710976.708818:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710976.709048:0:15152:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158214784 00000100:00100000:3.0:1790710976.709060:0:15152:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158214784 00000100:00100000:3.0:1790710976.709179:0:15152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 5 00000100:00100000:3.0:1790710976.709190:0:15152:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff87ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+5:13822:x1877696158214784:12345-192.168.206.46@tcp:13:lfs.0 00002000:00000024:3.0:1790710976.709249:0:15152:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790710976.709341:0:15152:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff87ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+5:13822:x1877696158214784:12345-192.168.206.46@tcp:13:lfs.0 Request processed in 152us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710976.709349:0:15152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 5 00000100:00080000:0.0:1790710976.710364:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790710976.870262:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710976.870479:0:14458:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158214912 00000100:00100000:0.0:1790710976.870492:0:14458:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158214912 00000100:00100000:0.0:1790710976.870781:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 91 00000100:00100000:0.0:1790710976.870804:0:14458:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c529d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b5b9c20-4564-43be-9f40-bd916384ea36+10:13854:x1877696158214912:12345-192.168.206.46@tcp:101:mount.lustre.0 00010000:00010000:0.0:1790710976.870828:0:14458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790710976.870861:0:14458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c51c0030a00/0xcbad34b281572100 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x566877b05700083e expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710976.870908:0:14458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c51c0030a00/0xcbad34b281572100 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700083e expref: 11 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710976.870921:0:14458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c51c0030a00/0xcbad34b281572100 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700083e expref: 11 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710976.870930:0:14458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c0030a00, rc 0) 00000100:00100000:0.0:1790710976.871006:0:14458:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c529d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b5b9c20-4564-43be-9f40-bd916384ea36+11:13854:x1877696158214912:12345-192.168.206.46@tcp:101:mount.lustre.0 Request processed in 215us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710976.871014:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 91 00000100:00100000:3.0:1790710976.876650:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710976.883328:0:14459:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158215040 00000100:00100000:2.0:1790710976.883352:0:14459:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158215040 00000100:00100000:2.0:1790710976.883425:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 92 00000100:00100000:2.0:1790710976.883452:0:14459:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4708850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b5b9c20-4564-43be-9f40-bd916384ea36+11:13854:x1877696158215040:12345-192.168.206.46@tcp:501:mount.lustre.0 00000100:00100000:2.0:1790710976.884195:0:14459:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4708850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b5b9c20-4564-43be-9f40-bd916384ea36+11:13854:x1877696158215040:12345-192.168.206.46@tcp:501:mount.lustre.0 Request processed in 739us (7553us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710976.884206:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 92 00000100:00100000:1.0:1790710976.891334:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710976.891487:0:14459:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158215168 00000100:00100000:2.0:1790710976.891501:0:14459:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158215168 00000100:00100000:2.0:1790710976.891572:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 93 00000100:00100000:2.0:1790710976.891593:0:14459:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4708450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b5b9c20-4564-43be-9f40-bd916384ea36+11:13854:x1877696158215168:12345-192.168.206.46@tcp:503:mount.lustre.0 00000100:00100000:2.0:1790710976.892805:0:14459:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4708450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b5b9c20-4564-43be-9f40-bd916384ea36+11:13854:x1877696158215168:12345-192.168.206.46@tcp:503:mount.lustre.0 Request processed in 1215us (1477us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710976.892819:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 93 00000100:00100000:3.0:1790710976.900656:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710976.900811:0:14457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158215296 00000100:00100000:1.0:1790710976.900825:0:14457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158215296 00000100:00100000:1.0:1790710976.900901:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 94 00000100:00100000:1.0:1790710976.900912:0:14457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f470a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b5b9c20-4564-43be-9f40-bd916384ea36+11:13861:x1877696158215296:12345-192.168.206.46@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790710976.901588:0:14457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f470a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b5b9c20-4564-43be-9f40-bd916384ea36+11:13861:x1877696158215296:12345-192.168.206.46@tcp:502:llog_process_th.0 Request processed in 662us (933us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710976.901609:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 94 00000100:00100000:3.0:1790710976.918319:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710976.918493:0:14459:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158215424 00000100:00100000:2.0:1790710976.918506:0:14459:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158215424 00000100:00100000:2.0:1790710976.918575:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 95 00000100:00100000:2.0:1790710976.918597:0:14459:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f470b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b5b9c20-4564-43be-9f40-bd916384ea36+11:13861:x1877696158215424:12345-192.168.206.46@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790710976.918943:0:14459:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f470b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b5b9c20-4564-43be-9f40-bd916384ea36+11:13861:x1877696158215424:12345-192.168.206.46@tcp:502:llog_process_th.0 Request processed in 348us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710976.918953:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 95 00000100:00100000:2.0:1790710976.921779:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710976.922188:0:14457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158215552 00000100:00100000:1.0:1790710976.922213:0:14457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158215552 00000100:00100000:1.0:1790710976.922282:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 96 00000100:00100000:1.0:1790710976.922294:0:14457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f470a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b5b9c20-4564-43be-9f40-bd916384ea36+11:13854:x1877696158215552:12345-192.168.206.46@tcp:101:mount.lustre.0 00010000:00010000:1.0:1790710976.922317:0:14457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790710976.923668:0:14457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c51ff134200/0xcbad34b281572107 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x566877b057000868 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710976.923722:0:14457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c51ff134200/0xcbad34b281572107 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000868 expref: 12 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710976.923738:0:14457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c51ff134200/0xcbad34b281572107 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000868 expref: 12 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710976.923750:0:14457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51ff134200, rc 0) 00000100:00100000:1.0:1790710976.923977:0:14457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f470a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b5b9c20-4564-43be-9f40-bd916384ea36+12:13854:x1877696158215552:12345-192.168.206.46@tcp:101:mount.lustre.0 Request processed in 1683us (2212us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710976.923988:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 96 00000100:00100000:3.0:1790710976.933083:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710976.933303:0:14458:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158215680 00000100:00100000:0.0:1790710976.933317:0:14458:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158215680 00000100:00100000:0.0:1790710976.933427:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 97 00000100:00100000:0.0:1790710976.933459:0:14458:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f470bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b5b9c20-4564-43be-9f40-bd916384ea36+12:13854:x1877696158215680:12345-192.168.206.46@tcp:256:mount.lustre.0 20000000:01000000:0.0:1790710976.933497:0:14458:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1790710976.933519:0:14458:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1790710976.933524:0:14458:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1790710976.933528:0:14458:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1790710976.933530:0:14458:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1790710976.935752:0:14458:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f470bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b5b9c20-4564-43be-9f40-bd916384ea36+12:13854:x1877696158215680:12345-192.168.206.46@tcp:256:mount.lustre.0 Request processed in 2281us (2673us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710976.935770:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 97 00000100:00100000:2.0:1790710976.938990:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710976.939060:0:14459:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158215808 00000100:00100000:0.0:1790710976.939074:0:14459:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158215808 00000100:00100000:0.0:1790710976.939160:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 98 00000100:00100000:0.0:1790710976.939172:0:14459:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4709450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b5b9c20-4564-43be-9f40-bd916384ea36+12:13854:x1877696158215808:12345-192.168.206.46@tcp:101:mount.lustre.0 00010000:00010000:0.0:1790710976.939197:0:14459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790710976.939218:0:14459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c51c0030800/0xcbad34b28157210e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x566877b05700086f expref: -99 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710976.939250:0:14459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c51c0030800/0xcbad34b28157210e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700086f expref: 13 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710976.939260:0:14459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c51c0030800/0xcbad34b28157210e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700086f expref: 13 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710976.939271:0:14459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c0030800, rc 0) 00000100:00100000:0.0:1790710976.939347:0:14459:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4709450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b5b9c20-4564-43be-9f40-bd916384ea36+13:13854:x1877696158215808:12345-192.168.206.46@tcp:101:mount.lustre.0 Request processed in 177us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710976.939355:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 98 00000100:00100000:2.0:1790710976.941461:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710976.941525:0:14458:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158215936 00000100:00100000:0.0:1790710976.941554:0:14458:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158215936 00000100:00100000:0.0:1790710976.941639:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 99 00000100:00100000:0.0:1790710976.941650:0:14458:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4708c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b5b9c20-4564-43be-9f40-bd916384ea36+13:13854:x1877696158215936:12345-192.168.206.46@tcp:501:mount.lustre.0 00000100:00100000:0.0:1790710976.942005:0:14458:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4708c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b5b9c20-4564-43be-9f40-bd916384ea36+13:13854:x1877696158215936:12345-192.168.206.46@tcp:501:mount.lustre.0 Request processed in 356us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710976.942014:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 99 00000100:00100000:3.0:1790710976.944509:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710976.944671:0:14459:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158216064 00000100:00100000:0.0:1790710976.944683:0:14459:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158216064 00000100:00100000:0.0:1790710976.945020:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 100 00000100:00100000:0.0:1790710976.945032:0:14459:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f470ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b5b9c20-4564-43be-9f40-bd916384ea36+13:13854:x1877696158216064:12345-192.168.206.46@tcp:503:mount.lustre.0 00000100:00100000:0.0:1790710976.945519:0:14459:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f470ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b5b9c20-4564-43be-9f40-bd916384ea36+13:13854:x1877696158216064:12345-192.168.206.46@tcp:503:mount.lustre.0 Request processed in 487us (1022us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710976.945528:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 100 00000100:00100000:2.0:1790710976.948770:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710976.948913:0:14457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158216192 00000100:00100000:1.0:1790710976.948926:0:14457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158216192 00000100:00100000:1.0:1790710976.949092:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 101 00000100:00100000:1.0:1790710976.949106:0:14457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f470b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b5b9c20-4564-43be-9f40-bd916384ea36+13:13864:x1877696158216192:12345-192.168.206.46@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790710976.949683:0:14457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f470b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b5b9c20-4564-43be-9f40-bd916384ea36+13:13864:x1877696158216192:12345-192.168.206.46@tcp:502:llog_process_th.0 Request processed in 576us (921us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710976.949694:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 101 00000100:00100000:2.0:1790710976.958020:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710976.958183:0:14459:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158216320 00000100:00100000:0.0:1790710976.958197:0:14459:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158216320 00000100:00100000:0.0:1790710976.958261:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 102 00000100:00100000:0.0:1790710976.958272:0:14459:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4708050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b5b9c20-4564-43be-9f40-bd916384ea36+13:13864:x1877696158216320:12345-192.168.206.46@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790710976.958729:0:14459:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4708050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b5b9c20-4564-43be-9f40-bd916384ea36+13:13864:x1877696158216320:12345-192.168.206.46@tcp:502:llog_process_th.0 Request processed in 456us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710976.958740:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 102 00000100:00100000:2.0:1790710976.971117:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710976.971799:0:14466:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158216448 00000100:00100000:1.0:1790710976.971812:0:14466:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158216448 00000100:00100000:1.0:1790710976.971872:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 10 00000100:00100000:1.0:1790710976.971882:0:14466:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8e8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2355:x1877696158216448:12345-192.168.206.46@tcp:38:mount.lustre.0 00010000:00080000:1.0:1790710976.971920:0:14466:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 60bc4eeb-e53c-48cd-af53-cb13b58e0a59@192.168.206.46@tcp t0 exp 0000000000000000 cur 454 last 0 00000020:00000080:1.0:1790710976.971966:0:14466:0:(genops.c:1384:class_connect()) connect: client 60bc4eeb-e53c-48cd-af53-cb13b58e0a59, cookie 0xcbad34b281572115 00000004:00100000:1.0:1790710976.972005:0:14466:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1790710976.972185:0:14466:0:(import.c:65:import_set_state_nolock()) ffff9c51c7e67000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790710976.972563:0:14466:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8e8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60bc4eeb-e53c-48cd-af53-cb13b58e0a59+6:2355:x1877696158216448:12345-192.168.206.46@tcp:38:mount.lustre.0 Request processed in 679us (1457us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710976.972573:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 10 00000100:00100000:2.0:1790710976.981746:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710976.981797:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710976.981902:0:14465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158216704 00000100:00100000:0.0:1790710976.981915:0:14465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158216704 00000100:00100000:0.0:1790710976.982002:0:14465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158216576 00000100:00100000:0.0:1790710976.982005:0:14465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158216576 00000100:00100000:0.0:1790710976.982028:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 11 00000100:00100000:0.0:1790710976.982038:0:14465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8e8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60bc4eeb-e53c-48cd-af53-cb13b58e0a59+7:13854:x1877696158216704:12345-192.168.206.46@tcp:41:mount.lustre.0 00000004:00000024:0.0:1790710976.982094:0:14465:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1790710976.982297:0:16341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 12 00000100:00100000:2.0:1790710976.982307:0:16341:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8e8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60bc4eeb-e53c-48cd-af53-cb13b58e0a59+7:0:x1877696158216576:12345-192.168.206.46@tcp:41:mount.lustre.0 00000004:00000024:2.0:1790710976.982322:0:16341:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00080000:1.0:1790710976.982379:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790710976.985043:0:14465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8e8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60bc4eeb-e53c-48cd-af53-cb13b58e0a59+7:13854:x1877696158216704:12345-192.168.206.46@tcp:41:mount.lustre.0 Request processed in 2990us (3296us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710976.985343:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 11 00000100:00100000:2.0:1790710976.985940:0:16341:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8e8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60bc4eeb-e53c-48cd-af53-cb13b58e0a59+6:0:x1877696158216576:12345-192.168.206.46@tcp:41:mount.lustre.0 Request processed in 3630us (4136us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710976.985950:0:16341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 12 00000100:00100000:0.0:1790710976.988676:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710976.988766:0:14464:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158216832 00000100:00100000:3.0:1790710976.988779:0:14464:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158216832 00000100:00100000:3.0:1790710976.989124:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 13 00000100:00100000:3.0:1790710976.989168:0:14464:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c50c35b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60bc4eeb-e53c-48cd-af53-cb13b58e0a59+6:13854:x1877696158216832:12345-192.168.206.46@tcp:40:mount.lustre.0 00000100:00100000:3.0:1790710976.989312:0:14464:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c50c35b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60bc4eeb-e53c-48cd-af53-cb13b58e0a59+6:13854:x1877696158216832:12345-192.168.206.46@tcp:40:mount.lustre.0 Request processed in 146us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710976.989321:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 13 00000100:00100000:1.0:1790710976.993011:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710976.993053:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710976.993081:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710976.993177:0:15150:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158216960 00000100:00100000:2.0:1790710976.993190:0:15150:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158216960 00000100:00100000:2.0:1790710976.993244:0:15150:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158217088 00000100:00100000:2.0:1790710976.993248:0:15150:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158217088 00000100:00100000:2.0:1790710976.993270:0:15150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 8 00000100:00100000:2.0:1790710976.993280:0:15150:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff87fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2355:x1877696158216960:12345-192.168.206.46@tcp:8:mount.lustre.0 00010000:00080000:2.0:1790710976.993319:0:15150:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 60bc4eeb-e53c-48cd-af53-cb13b58e0a59@192.168.206.46@tcp t0 exp 0000000000000000 cur 454 last 0 00000020:00000080:2.0:1790710976.993369:0:15150:0:(genops.c:1384:class_connect()) connect: client 60bc4eeb-e53c-48cd-af53-cb13b58e0a59, cookie 0xcbad34b28157211c 00002000:00100000:2.0:1790710976.993384:0:15150:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 60bc4eeb-e53c-48cd-af53-cb13b58e0a59/ffff9c50c2743000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790710976.993397:0:15150:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1790710976.993709:0:15150:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1790710976.993745:0:15150:0:(import.c:65:import_set_state_nolock()) ffff9c50c2746800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790710976.993828:0:15150:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff87fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60bc4eeb-e53c-48cd-af53-cb13b58e0a59+6:2355:x1877696158216960:12345-192.168.206.46@tcp:8:mount.lustre.0 Request processed in 547us (772us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710976.993853:0:15150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 8 00000100:00100000:2.0:1790710976.993878:0:15150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 9 00000100:00100000:2.0:1790710976.993883:0:15150:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff87ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2355:x1877696158217088:12345-192.168.206.46@tcp:8:mount.lustre.0 00010000:00080000:2.0:1790710976.993901:0:15150:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 60bc4eeb-e53c-48cd-af53-cb13b58e0a59@192.168.206.46@tcp t0 exp 0000000000000000 cur 454 last 0 00000020:00000080:2.0:1790710976.993919:0:15150:0:(genops.c:1384:class_connect()) connect: client 60bc4eeb-e53c-48cd-af53-cb13b58e0a59, cookie 0xcbad34b281572123 00002000:00100000:2.0:1790710976.993924:0:15150:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 60bc4eeb-e53c-48cd-af53-cb13b58e0a59/ffff9c50c2741000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790710976.993930:0:15150:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1790710976.994067:0:15150:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1790710976.994082:0:15150:0:(import.c:65:import_set_state_nolock()) ffff9c50c2740000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790710976.994105:0:15150:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff87ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60bc4eeb-e53c-48cd-af53-cb13b58e0a59+6:2355:x1877696158217088:12345-192.168.206.46@tcp:8:mount.lustre.0 Request processed in 221us (1024us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710976.994112:0:15150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 9 00000100:00100000:0.0:1790710976.994562:0:14468:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158217216 00000100:00100000:0.0:1790710976.994570:0:14468:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158217216 00000100:00100000:0.0:1790710976.994622:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 1 00000100:00100000:0.0:1790710976.994630:0:14468:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff87c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60bc4eeb-e53c-48cd-af53-cb13b58e0a59+6:13854:x1877696158217216:12345-192.168.206.46@tcp:33:mount.lustre.0 00000004:00200000:0.0:1790710976.994709:0:14468:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1790710976.994765:0:14468:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff87c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60bc4eeb-e53c-48cd-af53-cb13b58e0a59+6:13854:x1877696158217216:12345-192.168.206.46@tcp:33:mount.lustre.0 Request processed in 135us (1766us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710976.994772:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 1 00000100:00100000:2.0:1790710977.122676:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710977.122929:0:14465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158217344 00000100:00100000:0.0:1790710977.122942:0:14465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158217344 00000100:00100000:0.0:1790710977.123065:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 14 00000100:00100000:0.0:1790710977.123077:0:14465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8e8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60bc4eeb-e53c-48cd-af53-cb13b58e0a59+6:13885:x1877696158217344:12345-192.168.206.46@tcp:101:mkdir.0 00010000:00010000:0.0:1790710977.123104:0:14465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790710977.123161:0:14465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030200/0xcbad34b28157212a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b057000899 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710977.123528:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281572131 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710977.123546:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281572131 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710977.123591:0:14465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281572131 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790710977.123634:0:14465:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1790710977.123639:0:14465:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790710977.123665:0:14465:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281572131 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710977.123696:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030200/0xcbad34b28157212a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000899 expref: 8 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710977.123836:0:14465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281572131 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000899 expref: 7 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710977.123847:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c51d8e33400) 00010000:00010000:0.0:1790710977.123850:0:14465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790710977.123854:0:14465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c0030000, rc 0) 00000100:00100000:0.0:1790710977.123972:0:14465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8e8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60bc4eeb-e53c-48cd-af53-cb13b58e0a59+7:13885:x1877696158217344:12345-192.168.206.46@tcp:101:mkdir.0 Request processed in 896us (1309us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710977.123981:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 14 00010000:00010000:3.0:1790710977.672478:0:16043:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790710978.695400:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790710979.343490:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c75dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1877696177079936:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790710979.343555:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710979.343636:0:15151:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177079936 00000100:00100000:3.0:1790710979.343642:0:15151:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177079936 00000100:00100000:3.0:1790710979.343693:0:15151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790710979.343701:0:15151:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c75ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877696177079936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790710979.343733:0:15151:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790710979.343776:0:15151:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c75ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877696177079936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710979.343782:0:15151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1790710979.343801:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790710979.343834:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c75dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1877696177079936:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790710979.344223:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c8e8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1877696177080064:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790710979.344253:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710979.344280:0:15151:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177080064 00000100:00100000:3.0:1790710979.344284:0:15151:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177080064 00000100:00100000:3.0:1790710979.344308:0:15151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790710979.344315:0:15151:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c75dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877696177080064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790710979.344334:0:15151:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790710979.344364:0:15151:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c75dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877696177080064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 50us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710979.344385:0:15151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1790710979.344401:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790710979.344435:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c8e8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1877696177080064:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790710979.351630:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c8e8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:3311:1877696177080192:0@lo:400:kworker.0 00000100:00100000:2.0:1790710979.351705:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710979.351750:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790710979.351756:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c8e8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1877696177080320:0@lo:400:kworker.0 00000100:00100000:2.0:1790710979.351782:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710979.351818:0:14457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177080192 00000100:00100000:2.0:1790710979.351825:0:14457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177080192 00000100:00100000:2.0:1790710979.351866:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1790710979.351874:0:14457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4709c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+19:3311:x1877696177080192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790710979.351921:0:14457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4709c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+19:3311:x1877696177080192:12345-0@lo:400:kworker.0 Request processed in 48us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710979.351942:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1790710979.351975:0:14466:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177080320 00000100:00100000:2.0:1790710979.351979:0:14466:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177080320 00000100:00100000:2.0:1790710979.352005:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790710979.352012:0:14466:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8e8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1877696177080320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790710979.352043:0:14466:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8e8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1877696177080320:12345-0@lo:400:kworker.0 Request processed in 32us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710979.352049:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790710979.352069:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c8e8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1877696177080576:0@lo:400:kworker.0 00000100:00100000:2.0:1790710979.352093:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710979.352111:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790710979.352116:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c8e8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1877696177080448:0@lo:400:kworker.0 00000100:00100000:2.0:1790710979.352156:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710979.352176:0:16341:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177080576 00000100:00100000:2.0:1790710979.352180:0:16341:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177080576 00000100:00100000:2.0:1790710979.352222:0:16341:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177080448 00000100:00100000:2.0:1790710979.352225:0:16341:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177080448 00000100:00100000:2.0:1790710979.352244:0:16341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790710979.352250:0:16341:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8e8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1877696177080576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790710979.352284:0:16341:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8e8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1877696177080576:12345-0@lo:400:kworker.0 Request processed in 34us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710979.352289:0:16341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790710979.352302:0:16341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790710979.352308:0:16341:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8e8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1877696177080448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790710979.352333:0:16341:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8e8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1877696177080448:12345-0@lo:400:kworker.0 Request processed in 26us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710979.352347:0:16341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1790710979.352368:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790710979.352400:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c8e8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1877696177080320:0@lo:400:kworker.0 00000100:00100000:2.0:1790710979.352410:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c8e8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:3311:1877696177080192:0@lo:400:kworker.0 00000100:00100000:2.0:1790710979.352812:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c8e8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1877696177080448:0@lo:400:kworker.0 00000100:00100000:2.0:1790710979.352822:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c8e8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1877696177080576:0@lo:400:kworker.0 00000001:02000400:0.0:1790710979.599966:0:16430:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1790710979.721617:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1790710979.890441:0:5867:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 07f3a30d-977e-4e8f-a2f1-7a826af5c45b 00000001:00100000:3.0:1790710979.890454:0:5867:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 60bc4eeb-e53c-48cd-af53-cb13b58e0a59 00000001:00100000:1.0:1790710979.897914:0:6720:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 60bc4eeb-e53c-48cd-af53-cb13b58e0a59 00010000:00010000:3.0:1790710980.746110:0:16043:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1790710981.464875:0:7643:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 60bc4eeb-e53c-48cd-af53-cb13b58e0a59 00010000:00010000:0.0:1790710981.767485:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790710982.113823:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710982.113920:0:14458:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158217472 00000100:00100000:0.0:1790710982.113929:0:14458:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158217472 00000100:00100000:0.0:1790710982.113983:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 104 00000100:00100000:0.0:1790710982.113993:0:14458:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f470b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b5b9c20-4564-43be-9f40-bd916384ea36+13:2357:x1877696158217472:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:0.0:1790710982.114061:0:14458:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f470b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b5b9c20-4564-43be-9f40-bd916384ea36+13:2357:x1877696158217472:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 70us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710982.114083:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 104 00000100:00100000:2.0:1790710982.117838:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710982.117956:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710982.117979:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710982.118002:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710982.118024:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710982.118046:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710982.118088:0:15149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158217856 00000100:00100000:2.0:1790710982.118096:0:15149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158217856 00000100:00100000:2.0:1790710982.118249:0:15149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158218112 00000100:00100000:2.0:1790710982.118253:0:15149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158218112 00000100:00100000:2.0:1790710982.118270:0:15149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158217728 00000100:00100000:2.0:1790710982.118273:0:15149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158217728 00000100:00100000:2.0:1790710982.118287:0:15149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158218240 00000100:00100000:2.0:1790710982.118289:0:15149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158218240 00000100:00100000:2.0:1790710982.118306:0:15149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 0 00000100:00100000:2.0:1790710982.118315:0:15149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8e8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+5:2356:x1877696158217856:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:2.0:1790710982.118392:0:15149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8e8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+5:2356:x1877696158217856:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 76us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710982.118416:0:15149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 0 00000100:00100000:2.0:1790710982.118449:0:15149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 1 00000100:00100000:2.0:1790710982.118455:0:15149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8e8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60bc4eeb-e53c-48cd-af53-cb13b58e0a59+5:2356:x1877696158218112:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:2.0:1790710982.118483:0:15149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8e8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60bc4eeb-e53c-48cd-af53-cb13b58e0a59+5:2356:x1877696158218112:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 28us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710982.118489:0:15149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 1 00000100:00100000:2.0:1790710982.118499:0:15149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 2 00000100:00100000:2.0:1790710982.118505:0:15149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8e8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+5:2356:x1877696158217728:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:2.0:1790710982.118529:0:15149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8e8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+5:2356:x1877696158217728:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 23us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710982.118535:0:15149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 2 00000100:00100000:2.0:1790710982.118563:0:15149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 3 00000100:00100000:2.0:1790710982.118571:0:15149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8e8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60bc4eeb-e53c-48cd-af53-cb13b58e0a59+5:2356:x1877696158218240:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:2.0:1790710982.118596:0:15149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8e8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60bc4eeb-e53c-48cd-af53-cb13b58e0a59+5:2356:x1877696158218240:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 26us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710982.118602:0:15149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 3 00000100:00100000:1.0:1790710982.118742:0:16341:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158217600 00000100:00100000:1.0:1790710982.118748:0:16341:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158217600 00000100:00100000:1.0:1790710982.118790:0:16341:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158217984 00000100:00100000:1.0:1790710982.118794:0:16341:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158217984 00000100:00100000:2.0:1790710982.118811:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 17 00000100:00100000:2.0:1790710982.118821:0:14464:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8e8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+6:2356:x1877696158217600:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:2.0:1790710982.118854:0:14464:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8e8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+6:2356:x1877696158217600:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 36us (1027us total) trans 0 rc 0/0 00000100:00080000:0.0:1790710982.118870:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790710982.118881:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790710982.118883:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790710982.127691:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 18 00000100:00100000:0.0:1790710982.127711:0:14465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8e8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60bc4eeb-e53c-48cd-af53-cb13b58e0a59+6:2356:x1877696158217984:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:0.0:1790710982.127897:0:14465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8e8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60bc4eeb-e53c-48cd-af53-cb13b58e0a59+6:2356:x1877696158217984:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 193us (9871us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710982.127906:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 18 00000100:00100000:2.0:1790710982.132793:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 17 00000020:00000080:0.0:1790710982.604673:0:16580:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd519bf880 20000000:00000080:0.0:1790710982.604689:0:16580:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c50c1deac00 uarg=0000000000000000 20000000:01000000:0.0:1790710982.604723:0:16580:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1790710982.604728:0:16580:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1790710982.604732:0:16580:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1790710982.606065:0:16581:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:0.0:1790710982.606328:0:16580:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1790710982.614247:0:16580:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1790710982.614592:0:16580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c51f43f8a00/0xcbad34b281572138 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710982.614620:0:16580:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c51f43f8c00/0xcbad34b281571e2f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281571e28 expref: 18 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710982.614628:0:16580:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c51f43f9e00/0xcbad34b281571e7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281571e75 expref: 18 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710982.614635:0:16580:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c51c8046200/0xcbad34b281571eec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b281571ee5 expref: 18 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710982.614645:0:16580:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c51f43f8200/0xcbad34b2815720d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700080d expref: 12 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710982.614652:0:16580:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c51c0030800/0xcbad34b28157210e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700086f expref: 12 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710982.614659:0:16580:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c51f43f8a00/0xcbad34b281572138 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710982.614699:0:16580:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c51c0030800/0xcbad34b28157210e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.46@tcp remote: 0x566877b05700086f expref: 12 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710982.614714:0:16580:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c51c0030800/0xcbad34b28157210e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.46@tcp remote: 0x566877b05700086f expref: 12 pid: 14459 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710982.614728:0:16580:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c8e8ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16580:1877696177080704:192.168.206.46@tcp:104: 00010000:00010000:2.0:1790710982.614876:0:16580:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c51f43f8200/0xcbad34b2815720d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.46@tcp remote: 0x566877b05700080d expref: 12 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710982.614885:0:16580:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c51f43f8200/0xcbad34b2815720d6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.46@tcp remote: 0x566877b05700080d expref: 12 pid: 14459 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710982.614902:0:16580:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c8e8d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16580:1877696177080832:192.168.206.46@tcp:104: 00010000:00010000:2.0:1790710982.614933:0:16580:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c51c8046200/0xcbad34b281571eec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbad34b281571ee5 expref: 18 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710982.614941:0:16580:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c51c8046200/0xcbad34b281571eec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbad34b281571ee5 expref: 18 pid: 14457 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710982.614950:0:16580:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c8e8e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16580:1877696177080960:0@lo:104: 00000100:00100000:2.0:1790710982.614994:0:16580:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790710982.615031:0:16580:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c51f43f9e00/0xcbad34b281571e7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbad34b281571e75 expref: 18 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710982.615040:0:16580:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c51f43f9e00/0xcbad34b281571e7c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbad34b281571e75 expref: 18 pid: 14459 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710982.615048:0:16580:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51d03fad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16580:1877696177081088:0@lo:104: 00000100:00100000:2.0:1790710982.615066:0:16580:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790710982.615095:0:16580:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c51f43f8c00/0xcbad34b281571e2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbad34b281571e28 expref: 18 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710982.615104:0:16580:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c51f43f8c00/0xcbad34b281571e2f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbad34b281571e28 expref: 18 pid: 14459 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710982.615112:0:16580:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51d03f8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16580:1877696177081216:0@lo:104: 00000100:00100000:2.0:1790710982.615157:0:16580:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710982.615167:0:16580:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c81b0b40 going to sleep for 11 seconds 00000100:00100000:1.0:1790710982.615263:0:14447:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1790710982.615276:0:14447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177080960 00000100:00100000:1.0:1790710982.615282:0:14447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177080960 00000100:00100000:1.0:1790710982.615314:0:14447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177081088 00000100:00100000:1.0:1790710982.615316:0:14447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177081088 00000100:00100000:1.0:1790710982.615324:0:14447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177081216 00000100:00100000:1.0:1790710982.615326:0:14447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177081216 00000100:00100000:1.0:1790710982.615339:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790710982.615354:0:14447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8e8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+5:16580:x1877696177080960:12345-0@lo:104: 00010000:00010000:1.0:1790710982.615366:0:14447:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.146@tcp lock: ffff9c51f43f9600/0xcbad34b281571ee5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbad34b281571eec expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710982.615435:0:14447:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790710982.615441:0:14447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8e8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+5:16580:x1877696177080960:12345-0@lo:104: Request processed in 88us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710982.615447:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790710982.615473:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790710982.615480:0:14447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d03f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+4:16580:x1877696177081088:12345-0@lo:104: 00010000:00010000:1.0:1790710982.615487:0:14447:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.146@tcp lock: ffff9c51c243ac00/0xcbad34b281571e75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbad34b281571e7c expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710982.615521:0:14447:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1790710982.615527:0:14447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d03f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+4:16580:x1877696177081088:12345-0@lo:104: Request processed in 48us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710982.615532:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790710982.615544:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790710982.615562:0:14447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51fba98c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+3:16580:x1877696177081216:12345-0@lo:104: 00010000:00010000:1.0:1790710982.615570:0:14447:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.146@tcp lock: ffff9c51c243a400/0xcbad34b281571e28 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbad34b281571e2f expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710982.615601:0:14447:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1790710982.615606:0:14447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51fba98c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+3:16580:x1877696177081216:12345-0@lo:104: Request processed in 58us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710982.615612:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1790710982.615648:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1790710982.615658:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.146@tcp lock: ffff9c51f43f9600/0xcbad34b281571ee5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbad34b281571eec expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710982.615665:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51f43f9600 already unused, calling callback (ffffffffc1cdfc20) 10000000:00010000:1.0:1790710982.615668:0:14452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.146@tcp lock: ffff9c51f43f9600/0xcbad34b281571ee5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbad34b281571eec expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710982.615677:0:14452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.146@tcp lock: ffff9c51f43f9600/0xcbad34b281571ee5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbad34b281571eec expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790710982.615684:0:14452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.146@tcp lock: ffff9c51f43f9600/0xcbad34b281571ee5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbad34b281571eec expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790710982.615690:0:14452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790710982.615718:0:14452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.146@tcp lock: ffff9c51f43f9600/0xcbad34b281571ee5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281571eec expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710982.615725:0:14452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790710982.615744:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.146@tcp lock: ffff9c51f43f9600/0xcbad34b281571ee5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281571eec expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710982.615751:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.146@tcp lock: ffff9c51f43f9600/0xcbad34b281571ee5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281571eec expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710982.615763:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790710982.615766:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.146@tcp lock: ffff9c51c243ac00/0xcbad34b281571e75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbad34b281571e7c expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710982.615772:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c243ac00 already unused, calling callback (ffffffffc1cdfc20) 10000000:00010000:1.0:1790710982.615775:0:14452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.146@tcp lock: ffff9c51c243ac00/0xcbad34b281571e75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbad34b281571e7c expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710982.615792:0:14452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.146@tcp lock: ffff9c51c243ac00/0xcbad34b281571e75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbad34b281571e7c expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790710982.615799:0:14452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.146@tcp lock: ffff9c51c243ac00/0xcbad34b281571e75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbad34b281571e7c expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790710982.615804:0:14452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790710982.615817:0:14452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.146@tcp lock: ffff9c51c243ac00/0xcbad34b281571e75 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281571e7c expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710982.615822:0:14452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790710982.615828:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.146@tcp lock: ffff9c51c243ac00/0xcbad34b281571e75 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281571e7c expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710982.615835:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.146@tcp lock: ffff9c51c243ac00/0xcbad34b281571e75 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281571e7c expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710982.615844:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790710982.615847:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.146@tcp lock: ffff9c51c243a400/0xcbad34b281571e28 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbad34b281571e2f expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710982.615852:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c243a400 already unused, calling callback (ffffffffc1cdfc20) 10000000:00010000:1.0:1790710982.615855:0:14452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.146@tcp lock: ffff9c51c243a400/0xcbad34b281571e28 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbad34b281571e2f expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710982.615861:0:14452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.146@tcp lock: ffff9c51c243a400/0xcbad34b281571e28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbad34b281571e2f expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790710982.615868:0:14452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.146@tcp lock: ffff9c51c243a400/0xcbad34b281571e28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbad34b281571e2f expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790710982.615880:0:14452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790710982.615895:0:14452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.146@tcp lock: ffff9c51c243a400/0xcbad34b281571e28 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281571e2f expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710982.615900:0:14452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790710982.615916:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.146@tcp lock: ffff9c51c243a400/0xcbad34b281571e28 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281571e2f expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710982.615922:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.146@tcp lock: ffff9c51c243a400/0xcbad34b281571e28 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbad34b281571e2f expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710982.615934:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790710982.615936:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790710982.615937:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790710982.615944:0:16043:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790710982.615954:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51ff87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:3311:1877696177081344:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790710982.615984:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710982.616012:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790710982.616018:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51ff87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:3311:1877696177081472:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790710982.616037:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710982.616059:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51ff87ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:3309:1877696177081600:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790710982.616080:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710982.616108:0:14449:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177081344 00000100:00100000:1.0:1790710982.616113:0:14449:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177081344 00010000:00010000:1.0:1790710982.616164:0:14449:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c51c8046200/0xcbad34b281571eec lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbad34b281571ee5 expref: 19 pid: 14457 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710982.616177:0:14449:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177081472 00000100:00100000:1.0:1790710982.616186:0:14449:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177081472 00010000:00010000:1.0:1790710982.616198:0:14449:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c51f43f9e00/0xcbad34b281571e7c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbad34b281571e75 expref: 20 pid: 14459 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710982.616209:0:14449:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177081600 00000100:00100000:1.0:1790710982.616211:0:14449:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177081600 00010000:00010000:1.0:1790710982.616220:0:14449:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c51f43f8c00/0xcbad34b281571e2f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbad34b281571e28 expref: 21 pid: 14459 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710982.616231:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790710982.616237:0:14449:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d62d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+21:3311:x1877696177081344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790710982.616247:0:14449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790710982.616251:0:14449:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c51c8046200/0xcbad34b281571eec lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbad34b281571ee5 expref: 21 pid: 14457 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710982.616260:0:14449:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c51c8046200/0xcbad34b281571eec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbad34b281571ee5 expref: 21 pid: 14457 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710982.616273:0:14449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790710982.616302:0:14449:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d62d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+21:3311:x1877696177081344:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710982.616308:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790710982.616321:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790710982.616326:0:14449:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d63b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+20:3311:x1877696177081472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790710982.616332:0:14449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790710982.616336:0:14449:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c51f43f9e00/0xcbad34b281571e7c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbad34b281571e75 expref: 20 pid: 14459 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710982.616343:0:14449:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c51f43f9e00/0xcbad34b281571e7c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbad34b281571e75 expref: 20 pid: 14459 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710982.616361:0:14449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790710982.616383:0:14449:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d63b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+20:3311:x1877696177081472:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710982.616389:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790710982.616402:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790710982.616407:0:14449:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4189850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+19:3309:x1877696177081600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790710982.616415:0:14449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790710982.616419:0:14449:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c51f43f8c00/0xcbad34b281571e2f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbad34b281571e28 expref: 19 pid: 14459 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710982.616425:0:14449:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c51f43f8c00/0xcbad34b281571e2f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbad34b281571e28 expref: 19 pid: 14459 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710982.616434:0:14449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790710982.616457:0:14449:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4189850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+19:3309:x1877696177081600:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710982.616462:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790710982.616521:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51ff87ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:3309:1877696177081600:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790710982.616546:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51ff87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:3311:1877696177081472:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790710982.616568:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51ff87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:3311:1877696177081344:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790710982.616608:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790710982.616940:0:16580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c51c8046200/0xcbad34b281571eec lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbad34b281571ee5 expref: 18 pid: 14457 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710982.616966:0:16580:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c8e8e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16580:1877696177080960:0@lo:104: 00010000:00010000:2.0:1790710982.616978:0:16580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c51f43f9e00/0xcbad34b281571e7c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbad34b281571e75 expref: 17 pid: 14459 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710982.616985:0:16580:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51d03fad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16580:1877696177081088:0@lo:104: 00010000:00010000:2.0:1790710982.616993:0:16580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c51f43f8c00/0xcbad34b281571e2f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbad34b281571e28 expref: 16 pid: 14459 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710982.617000:0:16580:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51d03f8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16580:1877696177081216:0@lo:104: 00000100:00100000:3.0:1790710982.620272:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710982.620589:0:16580:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c8e8ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16580:1877696177080704:192.168.206.46@tcp:104: 00000100:00100000:2.0:1790710982.620602:0:16580:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c8e8d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16580:1877696177080832:192.168.206.46@tcp:104: 00010000:00010000:2.0:1790710982.620634:0:16580:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c51f43f8a00/0xcbad34b281572138 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710982.620670:0:14449:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158218368 00000100:00100000:1.0:1790710982.620680:0:14449:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158218368 00010000:00010000:1.0:1790710982.620718:0:14449:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c51c0030800/0xcbad34b28157210e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.46@tcp remote: 0x566877b05700086f expref: 13 pid: 14459 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710982.620774:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 7 00000100:00100000:1.0:1790710982.620784:0:14449:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c75dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0b5b9c20-4564-43be-9f40-bd916384ea36+13:2359:x1877696158218368:12345-192.168.206.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790710982.620799:0:14449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790710982.620805:0:14449:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c51c0030800/0xcbad34b28157210e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.46@tcp remote: 0x566877b05700086f expref: 13 pid: 14459 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710982.620815:0:14449:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c51c0030800/0xcbad34b28157210e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.46@tcp remote: 0x566877b05700086f expref: 13 pid: 14459 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710982.620831:0:14449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c51c0030800/0xcbad34b28157210e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.46@tcp remote: 0x566877b05700086f expref: 13 pid: 14459 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710982.620844:0:14449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790710982.620934:0:14449:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c75dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0b5b9c20-4564-43be-9f40-bd916384ea36+12:2359:x1877696158218368:12345-192.168.206.46@tcp:103:ldlm_bl.0 Request processed in 150us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710982.620942:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 7 00000100:00100000:1.0:1790710982.621186:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710982.621281:0:14450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158218496 00000100:00100000:0.0:1790710982.621287:0:14450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158218496 00010000:00010000:0.0:1790710982.621310:0:14450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c51f43f8200/0xcbad34b2815720d6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.46@tcp remote: 0x566877b05700080d expref: 12 pid: 14459 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710982.621340:0:14450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 8 00000100:00100000:0.0:1790710982.621347:0:14450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d62d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0b5b9c20-4564-43be-9f40-bd916384ea36+12:2359:x1877696158218496:12345-192.168.206.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790710982.621356:0:14450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790710982.621361:0:14450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c51f43f8200/0xcbad34b2815720d6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.46@tcp remote: 0x566877b05700080d expref: 12 pid: 14459 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710982.621383:0:14450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c51f43f8200/0xcbad34b2815720d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.46@tcp remote: 0x566877b05700080d expref: 12 pid: 14459 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710982.621396:0:14450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c51f43f8200/0xcbad34b2815720d6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.46@tcp remote: 0x566877b05700080d expref: 12 pid: 14459 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710982.621409:0:14450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c51f43f8a00/0xcbad34b281572138 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710982.621417:0:14450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c51f43f8a00/0xcbad34b281572138 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710982.621433:0:14450:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c51f43f8a00/0xcbad34b281572138 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710982.621440:0:14450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c51f43f8a00/0xcbad34b281572138 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710982.621448:0:14450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c51f43f8a00/0xcbad34b281572138 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710982.621580:0:14450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c51f43f8a00/0xcbad34b281572138 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710982.621586:0:14450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51f43f8a00 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:0.0:1790710982.621591:0:14450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c51f43f8a00/0xcbad34b281572138 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710982.621599:0:14450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c51f43f8a00/0xcbad34b281572138 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710982.621805:0:14450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c51f43f8a00/0xcbad34b281572138 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710982.621816:0:14450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790710982.621859:0:14450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d62d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0b5b9c20-4564-43be-9f40-bd916384ea36+11:2359:x1877696158218496:12345-192.168.206.46@tcp:103:ldlm_bl.0 Request processed in 511us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710982.621867:0:14450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 8 00010000:00010000:3.0:1790710982.622357:0:16580:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c51f43f8a00/0xcbad34b281572138 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710982.622367:0:16580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c51f43f8a00/0xcbad34b281572138 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710982.622373:0:16580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c51f43f8a00/0xcbad34b281572138 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710982.792294:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790710983.815308:0:16043:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1790710984.007313:0:14461:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790710984.007321:0:14461:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c51d02e9000 from 10 10000000:01000000:1.0:1790710984.007326:0:14461:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790710984.007372:0:14461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51ff135000/0xcbad34b28157213f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710984.007383:0:14461:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.146@tcp lock: ffff9c51ff135000/0xcbad34b28157213f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710984.007424:0:14461:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.146@tcp lock: ffff9c51ff135000/0xcbad34b28157213f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710984.007462:0:14461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d63b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:14461:1877696177081728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790710984.007527:0:14461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710984.007672:0:14459:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177081728 00000100:00100000:0.0:1790710984.007690:0:14459:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177081728 00000100:00100000:0.0:1790710984.007736:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1790710984.007744:0:14459:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4709050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+16:14461:x1877696177081728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790710984.007757:0:14459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790710984.007770:0:14459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c51c0030200/0xcbad34b281572146 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbad34b28157213f expref: -99 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710984.007791:0:14459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c51c0030200/0xcbad34b281572146 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbad34b28157213f expref: 17 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710984.007801:0:14459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c51c0030200/0xcbad34b281572146 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b28157213f expref: 17 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710984.007810:0:14459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c0030200, rc 0) 00000100:00100000:0.0:1790710984.007848:0:14459:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4709050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+17:14461:x1877696177081728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710984.007854:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1790710984.007914:0:14461:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c3f8c780 going to sleep for 11 seconds 00000100:00100000:1.0:1790710984.007935:0:14461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d63b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:14461:1877696177081728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790710984.007949:0:14461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.146@tcp lock: ffff9c51ff135000/0xcbad34b28157213f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281572146 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710984.007957:0:14461:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.146@tcp lock: ffff9c51ff135000/0xcbad34b28157213f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbad34b281572146 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710984.008008:0:14461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d63b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:14461:1877696177081856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790710984.008033:0:14461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710984.008063:0:14461:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c3f8c780 going to sleep for 11 seconds 00000100:00100000:2.0:1790710984.008602:0:14458:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177081856 00000100:00100000:2.0:1790710984.008609:0:14458:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177081856 00000100:00100000:2.0:1790710984.008690:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1790710984.008698:0:14458:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4709850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+17:14461:x1877696177081856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790710984.008965:0:14458:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4709850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+17:14461:x1877696177081856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 267us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710984.008973:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1790710984.009220:0:14461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d63b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:14461:1877696177081856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790710984.009308:0:14461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c50c35b3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:14461:1877696177081984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790710984.009349:0:14461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710984.009388:0:14461:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51d8a96f00 going to sleep for 11 seconds 00000100:00100000:3.0:1790710984.009509:0:14457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177081984 00000100:00100000:3.0:1790710984.009515:0:14457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177081984 00000100:00100000:2.0:1790710984.009556:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1790710984.009566:0:14458:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f470a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+17:14461:x1877696177081984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790710984.009762:0:14458:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f470a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+17:14461:x1877696177081984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 197us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710984.009775:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1790710984.009848:0:14461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c50c35b3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:14461:1877696177081984:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1790710984.010636:0:16659:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1790710984.011780:0:14461:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1790710984.011811:0:14461:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790710984.011822:0:14461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51ff135000/0xcbad34b28157213f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281572146 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710984.011834:0:14461:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.146@tcp lock: ffff9c51ff135000/0xcbad34b28157213f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281572146 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790710984.011844:0:14461:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790710984.011847:0:14461:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c51f8c95000 from 10 10000000:01000000:0.0:1790710984.011850:0:14461:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790710984.011888:0:14461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c0030c00/0xcbad34b28157214d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710984.011895:0:14461:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.146@tcp lock: ffff9c51c0030c00/0xcbad34b28157214d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710984.011905:0:14461:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.146@tcp lock: ffff9c51c0030c00/0xcbad34b28157214d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710984.011927:0:14461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c50c35b3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:14461:1877696177082112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790710984.011979:0:14461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710984.012017:0:14461:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51d8e87780 going to sleep for 11 seconds 00000100:00100000:3.0:1790710984.012086:0:14457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177082112 00000100:00100000:3.0:1790710984.012092:0:14457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177082112 00000100:00100000:3.0:1790710984.012230:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1790710984.012239:0:14457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f470fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+17:14461:x1877696177082112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790710984.012252:0:14457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790710984.012263:0:14457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c51c1645400/0xcbad34b281572154 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbad34b28157214d expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710984.012299:0:14457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c51c1645400/0xcbad34b281572154 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbad34b28157214d expref: 18 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710984.012308:0:14457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c51c1645400/0xcbad34b281572154 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b28157214d expref: 18 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710984.012321:0:14457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c1645400, rc 0) 00000100:00100000:3.0:1790710984.012369:0:14457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f470fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+18:14461:x1877696177082112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710984.012375:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1790710984.012453:0:14461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c50c35b3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:14461:1877696177082112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790710984.012467:0:14461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.146@tcp lock: ffff9c51c0030c00/0xcbad34b28157214d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281572154 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710984.012485:0:14461:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.146@tcp lock: ffff9c51c0030c00/0xcbad34b28157214d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbad34b281572154 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710984.012531:0:14461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c50c35b3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:14461:1877696177082240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790710984.012585:0:14461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710984.012910:0:14461:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51d8e87780 going to sleep for 11 seconds 00000100:00100000:1.0:1790710984.012946:0:14459:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177082240 00000100:00100000:1.0:1790710984.012951:0:14459:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177082240 00000100:00100000:0.0:1790710984.013096:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1790710984.013104:0:14459:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f470d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+18:14461:x1877696177082240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790710984.013371:0:14459:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f470d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+18:14461:x1877696177082240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 267us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710984.013379:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1790710984.013466:0:14461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c50c35b3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:14461:1877696177082240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790710984.013507:0:14461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d63b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:14461:1877696177082368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790710984.013555:0:14461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710984.014272:0:14461:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c3f8c780 going to sleep for 11 seconds 00000100:00100000:3.0:1790710984.014311:0:14457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177082368 00000100:00100000:3.0:1790710984.014318:0:14457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177082368 00000100:00100000:3.0:1790710984.014348:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1790710984.014355:0:14457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f470cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+18:14461:x1877696177082368:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790710984.014568:0:14457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f470cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+18:14461:x1877696177082368:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 212us (1022us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710984.014578:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1790710984.014802:0:14461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d63b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:14461:1877696177082368:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1790710984.016003:0:16660:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1790710984.016213:0:14461:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1790710984.016239:0:14461:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790710984.016250:0:14461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51c0030c00/0xcbad34b28157214d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281572154 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710984.016263:0:14461:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.146@tcp lock: ffff9c51c0030c00/0xcbad34b28157214d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281572154 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790710984.016274:0:14461:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790710984.016276:0:14461:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c51f49a9800 from 10 10000000:01000000:2.0:1790710984.016279:0:14461:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790710984.016315:0:14461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51f43f9e00/0xcbad34b28157215b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710984.016322:0:14461:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.146@tcp lock: ffff9c51f43f9e00/0xcbad34b28157215b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710984.016333:0:14461:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.146@tcp lock: ffff9c51f43f9e00/0xcbad34b28157215b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710984.016354:0:14461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51d03f8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:14461:1877696177082496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790710984.016410:0:14461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710984.016596:0:14461:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f4ecf9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790710984.016642:0:14457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177082496 00000100:00100000:3.0:1790710984.016649:0:14457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177082496 00000100:00100000:3.0:1790710984.016728:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1790710984.016738:0:14457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f470ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+18:14461:x1877696177082496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790710984.016752:0:14457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790710984.016764:0:14457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c51c1645000/0xcbad34b281572162 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbad34b28157215b expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710984.016787:0:14457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c51c1645000/0xcbad34b281572162 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbad34b28157215b expref: 19 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710984.016811:0:14457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c51c1645000/0xcbad34b281572162 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbad34b28157215b expref: 19 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710984.016819:0:14457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c1645000, rc 0) 00000100:00100000:3.0:1790710984.016869:0:14457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f470ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+19:14461:x1877696177082496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710984.016876:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1790710984.016953:0:14461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51d03f8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:14461:1877696177082496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790710984.016967:0:14461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.146@tcp lock: ffff9c51f43f9e00/0xcbad34b28157215b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281572162 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710984.016974:0:14461:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.146@tcp lock: ffff9c51f43f9e00/0xcbad34b28157215b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbad34b281572162 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710984.017037:0:14461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d63b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:14461:1877696177082624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790710984.017064:0:14461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710984.017086:0:14461:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c3f8c780 going to sleep for 11 seconds 00000100:00100000:0.0:1790710984.019877:0:14459:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177082624 00000100:00100000:0.0:1790710984.019893:0:14459:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177082624 00000100:00100000:0.0:1790710984.019955:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1790710984.019965:0:14459:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f470f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+19:14461:x1877696177082624:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790710984.020266:0:14459:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f470f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+19:14461:x1877696177082624:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 301us (3198us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710984.020274:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1790710984.020383:0:14461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d63b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:14461:1877696177082624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790710984.020430:0:14461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d63b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:14461:1877696177082752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790710984.020554:0:14461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710984.020590:0:14461:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c3f8c780 going to sleep for 11 seconds 00000100:00100000:2.0:1790710984.020658:0:14458:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177082752 00000100:00100000:2.0:1790710984.020663:0:14458:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177082752 00000100:00100000:2.0:1790710984.020696:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1790710984.020703:0:14458:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f470c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+19:14461:x1877696177082752:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790710984.020850:0:14458:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f470c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+19:14461:x1877696177082752:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 146us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710984.020863:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1790710984.020948:0:14461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d63b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:14461:1877696177082752:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1790710984.021880:0:16661:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1790710984.023174:0:14461:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1790710984.023202:0:14461:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790710984.023213:0:14461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.146@tcp lock: ffff9c51f43f9e00/0xcbad34b28157215b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281572162 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710984.023226:0:14461:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.146@tcp lock: ffff9c51f43f9e00/0xcbad34b28157215b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbad34b281572162 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710984.157764:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710984.157955:0:14458:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158218624 00000100:00100000:0.0:1790710984.157965:0:14458:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158218624 00000100:00100000:0.0:1790710984.158020:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 114 00000100:00100000:0.0:1790710984.158030:0:14458:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f470dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b5b9c20-4564-43be-9f40-bd916384ea36+11:13739:x1877696158218624:12345-192.168.206.46@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790710984.158047:0:14458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790710984.158070:0:14458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c51c0030800/0xcbad34b281572169 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x566877b0570008a0 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710984.158100:0:14458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c51c0030800/0xcbad34b281572169 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570008a0 expref: 12 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710984.158111:0:14458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c51c0030800/0xcbad34b281572169 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570008a0 expref: 12 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710984.158122:0:14458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c0030800, rc 0) 00000100:00100000:0.0:1790710984.158196:0:14458:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f470dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b5b9c20-4564-43be-9f40-bd916384ea36+12:13739:x1877696158218624:12345-192.168.206.46@tcp:101:ll_cfg_requeue.0 Request processed in 167us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710984.158203:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 114 00000100:00100000:1.0:1790710984.162462:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710984.162530:0:14459:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158218752 00000100:00100000:0.0:1790710984.162550:0:14459:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158218752 00000100:00100000:0.0:1790710984.162604:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 115 00000100:00100000:0.0:1790710984.162613:0:14459:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f470f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b5b9c20-4564-43be-9f40-bd916384ea36+12:13739:x1877696158218752:12345-192.168.206.46@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790710984.163631:0:14459:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f470f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b5b9c20-4564-43be-9f40-bd916384ea36+12:13739:x1877696158218752:12345-192.168.206.46@tcp:501:ll_cfg_requeue.0 Request processed in 1012us (1172us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710984.163642:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 115 00000100:00100000:3.0:1790710984.173400:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710984.173713:0:14458:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158218880 00000100:00100000:0.0:1790710984.173723:0:14458:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158218880 00000100:00100000:0.0:1790710984.173766:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 116 00000100:00100000:0.0:1790710984.173775:0:14458:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f470d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b5b9c20-4564-43be-9f40-bd916384ea36+12:13739:x1877696158218880:12345-192.168.206.46@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790710984.173981:0:14458:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f470d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b5b9c20-4564-43be-9f40-bd916384ea36+12:13739:x1877696158218880:12345-192.168.206.46@tcp:503:ll_cfg_requeue.0 Request processed in 206us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710984.173988:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 116 00000100:00100000:3.0:1790710984.181976:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710984.185898:0:14459:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158219008 00000100:00100000:0.0:1790710984.185909:0:14459:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158219008 00000100:00100000:0.0:1790710984.185967:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 117 00000100:00100000:0.0:1790710984.185976:0:14459:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f470d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b5b9c20-4564-43be-9f40-bd916384ea36+12:13739:x1877696158219008:12345-192.168.206.46@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790710984.185993:0:14459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790710984.186009:0:14459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c51c0031800/0xcbad34b281572170 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x566877b0570008a7 expref: -99 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710984.186035:0:14459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c51c0031800/0xcbad34b281572170 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570008a7 expref: 13 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710984.186047:0:14459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c51c0031800/0xcbad34b281572170 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570008a7 expref: 13 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710984.186056:0:14459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c0031800, rc 0) 00000100:00100000:0.0:1790710984.186158:0:14459:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f470d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b5b9c20-4564-43be-9f40-bd916384ea36+13:13739:x1877696158219008:12345-192.168.206.46@tcp:101:ll_cfg_requeue.0 Request processed in 183us (4190us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710984.186166:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 117 00000100:00100000:2.0:1790710984.191373:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710984.191584:0:14457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158219136 00000100:00100000:3.0:1790710984.191593:0:14457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158219136 00000100:00100000:3.0:1790710984.191647:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 118 00000100:00100000:3.0:1790710984.191658:0:14457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f470e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b5b9c20-4564-43be-9f40-bd916384ea36+13:13739:x1877696158219136:12345-192.168.206.46@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790710984.192726:0:14457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f470e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b5b9c20-4564-43be-9f40-bd916384ea36+13:13739:x1877696158219136:12345-192.168.206.46@tcp:501:ll_cfg_requeue.0 Request processed in 1063us (1355us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710984.192738:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 118 00000100:00100000:3.0:1790710984.195667:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710984.196053:0:14459:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158219264 00000100:00100000:0.0:1790710984.196063:0:14459:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158219264 00000100:00100000:0.0:1790710984.196198:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 119 00000100:00100000:0.0:1790710984.196209:0:14459:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f470c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b5b9c20-4564-43be-9f40-bd916384ea36+13:13739:x1877696158219264:12345-192.168.206.46@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790710984.196442:0:14459:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f470c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b5b9c20-4564-43be-9f40-bd916384ea36+13:13739:x1877696158219264:12345-192.168.206.46@tcp:503:ll_cfg_requeue.0 Request processed in 234us (925us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710984.196452:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 119 00000100:00100000:3.0:1790710984.455420:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c50c35b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877696177083264:0@lo:400:kworker.0 00000100:00100000:1.0:1790710984.455486:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c50c35b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1877696177083008:0@lo:400:kworker.0 00000100:00100000:3.0:1790710984.455493:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710984.455565:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710984.455598:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c50c35b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1877696177083136:0@lo:400:kworker.0 00000100:00100000:1.0:1790710984.455609:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c50c35b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1877696177083392:0@lo:400:kworker.0 00000100:00100000:3.0:1790710984.455643:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710984.455653:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710984.455676:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1790710984.455685:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51c75de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1877696177082880:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790710984.455699:0:15149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177083008 00000100:00100000:3.0:1790710984.455713:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710984.455739:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c50c35b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1877696177083520:0@lo:400:kworker.0 00000100:00100000:3.0:1790710984.455765:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710984.455793:0:15148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177083136 00000100:00100000:3.0:1790710984.455797:0:15148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177083136 00000100:00100000:0.0:1790710984.455856:0:14466:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177083264 00000100:00100000:3.0:1790710984.455863:0:15148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790710984.455863:0:14466:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177083264 00000100:00100000:3.0:1790710984.455872:0:15148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c75ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1877696177083136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790710984.455908:0:14466:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177083392 00000100:00100000:0.0:1790710984.455913:0:14466:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177083392 00000100:00100000:3.0:1790710984.455925:0:15148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c75ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1877696177083136:12345-0@lo:400:kworker.0 Request processed in 54us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710984.455928:0:14466:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177083520 00000100:00100000:0.0:1790710984.455932:0:14466:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177083520 00000100:00100000:3.0:1790710984.455936:0:15148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790710984.455951:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790710984.455960:0:14466:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c75dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877696177083264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790710984.455976:0:15151:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177082880 00000100:00100000:3.0:1790710984.455981:0:15151:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177082880 00000100:00100000:0.0:1790710984.456004:0:14466:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c75dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877696177083264:12345-0@lo:400:kworker.0 Request processed in 45us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710984.456010:0:15151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790710984.456016:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790710984.456020:0:15151:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c75dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877696177082880:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790710984.456034:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790710984.456043:0:14466:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff87f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1877696177083392:12345-0@lo:400:kworker.0 00002000:00000024:3.0:1790710984.456046:0:15151:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790710984.456089:0:14466:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff87f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1877696177083392:12345-0@lo:400:kworker.0 Request processed in 47us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710984.456092:0:15151:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c75dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877696177082880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710984.456101:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790710984.456103:0:15151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790710984.456121:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1790710984.456156:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790710984.456156:0:14466:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c75de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1877696177083520:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1790710984.456162:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790710984.456203:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c50c35b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877696177083264:0@lo:400:kworker.0 00000100:00100000:1.0:1790710984.456220:0:15149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177083008 00000100:00100000:1.0:1790710984.456257:0:15149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790710984.456264:0:15149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1877696177083008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790710984.456378:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790710984.456388:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51d03fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177083648:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790710984.458731:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51c75de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1877696177082880:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790710984.458754:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c50c35b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1877696177083520:0@lo:400:kworker.0 00000100:00100000:3.0:1790710984.458765:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c50c35b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1877696177083136:0@lo:400:kworker.0 00000100:00100000:0.0:1790710984.460472:0:14466:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c75de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1877696177083520:12345-0@lo:400:kworker.0 Request processed in 4336us (4697us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710984.460487:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790710984.460964:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c50c35b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1877696177083392:0@lo:400:kworker.0 00000100:00080000:0.0:1790710984.460999:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790710984.461696:0:15149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1877696177083008:12345-0@lo:400:kworker.0 Request processed in 5429us (6128us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710984.461706:0:15149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790710984.462795:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710984.462801:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c50c35b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1877696177083008:0@lo:400:kworker.0 00000100:00100000:3.0:1790710984.463219:0:15151:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177083648 00000100:00100000:3.0:1790710984.463227:0:15151:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177083648 00000100:00100000:3.0:1790710984.463321:0:15151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790710984.463344:0:15151:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d03fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877696177083648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790710984.463380:0:15151:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790710984.463436:0:15151:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d03fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877696177083648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710984.463442:0:15151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790710984.463512:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51d03fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1877696177083648:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1790710984.839647:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790710985.159980:0:14496:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1790710985.399756:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710985.399851:0:16341:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158219392 00000100:00100000:3.0:1790710985.399861:0:16341:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158219392 00000100:00100000:3.0:1790710985.399939:0:16341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 15 00000100:00100000:3.0:1790710985.399949:0:16341:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff87f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+6:14395:x1877696158219392:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790710985.399979:0:16341:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790710985.400000:0:16341:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b281572177 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b0570008ae expref: -99 pid: 16341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710985.400076:0:16341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645e00/0xcbad34b28157217e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710985.400094:0:16341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645e00/0xcbad34b28157217e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710985.400107:0:16341:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645e00/0xcbad34b28157217e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710985.400121:0:16341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281572185 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710985.400162:0:16341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281572185 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710985.400170:0:16341:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281572185 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1790710985.400735:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1790710985.400872:0:16341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645800/0xcbad34b28157218c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710985.400884:0:16341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645800/0xcbad34b28157218c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710985.400892:0:16341:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645800/0xcbad34b28157218c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790710985.400917:0:16341:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790710985.400921:0:16341:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790710985.401014:0:16341:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645800/0xcbad34b28157218c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710985.401027:0:16341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645e00/0xcbad34b28157217e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710985.401033:0:16341:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645e00/0xcbad34b28157217e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710985.401041:0:16341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645e00/0xcbad34b28157217e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710985.401048:0:16341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c1645e00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1790710985.401053:0:16341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645e00/0xcbad34b28157217e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710985.401061:0:16341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645e00/0xcbad34b28157217e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710985.401074:0:16341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c51d8e33400) 00010000:00010000:3.0:1790710985.401083:0:16341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790710985.401089:0:16341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645e00/0xcbad34b28157217e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710985.401095:0:16341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645e00/0xcbad34b28157217e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710985.401108:0:16341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281572185 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710985.401114:0:16341:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281572185 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710985.401120:0:16341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281572185 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710985.401218:0:16341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c1645200 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1790710985.401224:0:16341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281572185 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710985.401232:0:16341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281572185 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710985.401241:0:16341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9c51d8eb0600) 00010000:00010000:3.0:1790710985.401244:0:16341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790710985.401256:0:16341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281572185 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710985.401263:0:16341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281572185 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710985.401304:0:16341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b281572177 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570008ae expref: 8 pid: 16341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710985.401334:0:16341:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645800/0xcbad34b28157218c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570008ae expref: 7 pid: 16341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710985.401341:0:16341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c51d8eb0200) 00010000:00010000:3.0:1790710985.401344:0:16341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790710985.401346:0:16341:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c1645800, rc 0) 00000100:00100000:3.0:1790710985.401419:0:16341:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff87f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+7:14395:x1877696158219392:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 Request processed in 1472us (1673us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710985.401428:0:16341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 15 00000100:00100000:2.0:1790710985.404377:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710985.404463:0:14466:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158219648 00000100:00100000:0.0:1790710985.404473:0:14466:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158219648 00000100:00100000:0.0:1790710985.404553:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 16 00000100:00100000:0.0:1790710985.404562:0:14466:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d03fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+7:14395:x1877696158219648:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790710985.404582:0:14466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790710985.404601:0:14466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030400/0xcbad34b281572193 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b0570008b5 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710985.404666:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030e00/0xcbad34b28157219a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710985.404680:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030e00/0xcbad34b28157219a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710985.404691:0:14466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030e00/0xcbad34b28157219a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710985.404706:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031000/0xcbad34b2815721a1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710985.404713:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031000/0xcbad34b2815721a1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710985.404720:0:14466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031000/0xcbad34b2815721a1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710985.405122:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031600/0xcbad34b2815721a8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710985.405202:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031600/0xcbad34b2815721a8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710985.405211:0:14466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031600/0xcbad34b2815721a8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790710985.405232:0:14466:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1790710985.405769:0:14466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030e00/0xcbad34b28157219a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710985.405779:0:14466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030e00/0xcbad34b28157219a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710985.405787:0:14466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030e00/0xcbad34b28157219a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710985.405794:0:14466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c0030e00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1790710985.405799:0:14466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030e00/0xcbad34b28157219a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710985.405807:0:14466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030e00/0xcbad34b28157219a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710985.405819:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c51d8eb0200) 00010000:00010000:0.0:1790710985.405823:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790710985.405827:0:14466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030e00/0xcbad34b28157219a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710985.405834:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030e00/0xcbad34b28157219a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710985.405845:0:14466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031000/0xcbad34b2815721a1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710985.405852:0:14466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031000/0xcbad34b2815721a1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710985.405869:0:14466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031000/0xcbad34b2815721a1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710985.405875:0:14466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c0031000 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1790710985.405878:0:14466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031000/0xcbad34b2815721a1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710985.405884:0:14466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031000/0xcbad34b2815721a1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710985.405892:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9c51c7c52a00) 00010000:00010000:0.0:1790710985.405895:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790710985.405898:0:14466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031000/0xcbad34b2815721a1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710985.405904:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031000/0xcbad34b2815721a1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710985.406928:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030400/0xcbad34b281572193 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570008b5 expref: 10 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710985.406949:0:14466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031600/0xcbad34b2815721a8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570008b5 expref: 9 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710985.408118:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c51c7c52400) 00010000:00010000:0.0:1790710985.408122:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790710985.408190:0:14466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c0031600, rc 0) 00000100:00100000:0.0:1790710985.408382:0:14466:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d03fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+9:14395:x1877696158219648:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 Request processed in 3817us (4009us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1790710985.408406:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 16 00000100:00100000:0.0:1790710985.415988:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710985.416148:0:14464:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158219776 00000100:00100000:1.0:1790710985.416158:0:14464:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158219776 00000100:00100000:1.0:1790710985.416210:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 17 00000100:00100000:1.0:1790710985.416219:0:14464:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c50c35b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+9:14395:x1877696158219776:12345-192.168.206.46@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1790710985.416327:0:14464:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c50c35b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+9:14395:x1877696158219776:12345-192.168.206.46@tcp:59:lhsmtool_posix.0 Request processed in 109us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710985.416335:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 17 00000100:00100000:1.0:1790710985.464050:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710985.464293:0:14465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158219904 00000100:00100000:2.0:1790710985.464303:0:14465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158219904 00000100:00100000:2.0:1790710985.464486:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 18 00000100:00100000:2.0:1790710985.464496:0:14465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff87ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+9:14401:x1877696158219904:12345-192.168.206.46@tcp:101:lfs.0 00010000:00010000:2.0:1790710985.464517:0:14465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790710985.464550:0:14465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8200/0xcbad34b2815721b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b0570008bc expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710985.464616:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8c00/0xcbad34b2815721bd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710985.464630:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8c00/0xcbad34b2815721bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710985.464641:0:14465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8c00/0xcbad34b2815721bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710985.464654:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8a00/0xcbad34b2815721c4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710985.464676:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8a00/0xcbad34b2815721c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710985.464682:0:14465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8a00/0xcbad34b2815721c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710985.464854:0:14465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8c00/0xcbad34b2815721bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710985.464863:0:14465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8c00/0xcbad34b2815721bd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710985.464870:0:14465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8c00/0xcbad34b2815721bd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710985.464876:0:14465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51f43f8c00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1790710985.464880:0:14465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8c00/0xcbad34b2815721bd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710985.464888:0:14465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8c00/0xcbad34b2815721bd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710985.464899:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c51d8e33400) 00010000:00010000:2.0:1790710985.464903:0:14465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790710985.464907:0:14465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8c00/0xcbad34b2815721bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710985.464913:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8c00/0xcbad34b2815721bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710985.464924:0:14465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8a00/0xcbad34b2815721c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710985.464936:0:14465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8a00/0xcbad34b2815721c4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710985.465084:0:14465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8a00/0xcbad34b2815721c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710985.465104:0:14465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51f43f8a00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1790710985.465107:0:14465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8a00/0xcbad34b2815721c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710985.465114:0:14465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8a00/0xcbad34b2815721c4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710985.465122:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9c51cca25100) 00010000:00010000:2.0:1790710985.465176:0:14465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790710985.465182:0:14465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8a00/0xcbad34b2815721c4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710985.465188:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8a00/0xcbad34b2815721c4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710985.465219:0:14465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8200/0xcbad34b2815721b6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570008bc expref: 10 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710985.465228:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c51d8e33400) 00010000:00010000:2.0:1790710985.465230:0:14465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790710985.465234:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8200/0xcbad34b2815721b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570008bc expref: 10 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710985.465254:0:14465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51f43f8200, rc 0) 00000100:00100000:2.0:1790710985.465334:0:14465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff87ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+9:14401:x1877696158219904:12345-192.168.206.46@tcp:101:lfs.0 Request processed in 825us (1281us total) trans 0 rc 301/301 00000100:00100000:2.0:1790710985.465344:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 18 00000100:00100000:2.0:1790710985.479819:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710985.479985:0:14473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158220032 00000100:00100000:3.0:1790710985.479999:0:14473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158220032 00000100:00100000:3.0:1790710985.480343:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 0 00000100:00100000:3.0:1790710985.480358:0:14473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d03fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+9:14401:x1877696158220032:12345-192.168.206.46@tcp:700:lfs.0 00000100:00100000:3.0:1790710985.480475:0:14473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d03fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+9:14401:x1877696158220032:12345-192.168.206.46@tcp:700:lfs.0 Request processed in 120us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710985.480483:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 0 00000100:00100000:3.0:1790710985.483037:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710985.483335:0:16341:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158220288 00000100:00100000:0.0:1790710985.483347:0:16341:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158220288 00000100:00100000:0.0:1790710985.483422:0:16341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 19 00000100:00100000:0.0:1790710985.483433:0:16341:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c75de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+9:14401:x1877696158220288:12345-192.168.206.46@tcp:36:lfs.0 00010000:00010000:0.0:1790710985.483509:0:16341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790710985.483552:0:16341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ff134000/0xcbad34b2815720f9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000837 expref: 9 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710985.483575:0:16341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c51d8e33400) 00010000:00010000:0.0:1790710985.483580:0:16341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790710985.483871:0:16341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030400/0xcbad34b2815721cb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710985.483888:0:16341:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281572131 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000899 expref: 5 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710985.483899:0:16341:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030400/0xcbad34b2815721cb lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710985.483943:0:16341:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281572131 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.46@tcp remote: 0x566877b057000899 expref: 5 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710985.483960:0:16341:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281572131 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000899 expref: 5 pid: 14465 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710985.483977:0:16341:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c50c35b0700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16341:1877696177083776:192.168.206.46@tcp:104: 00000100:00100000:0.0:1790710985.484122:0:16341:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c7bff180 going to sleep for 11 seconds 00000100:00100000:1.0:1790710985.487877:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710985.488024:0:16341:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c50c35b0700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16341:1877696177083776:192.168.206.46@tcp:104: 00010000:00010000:0.0:1790710985.488059:0:16341:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030400/0xcbad34b2815721cb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710985.488561:0:14449:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158220416 00000100:00100000:2.0:1790710985.488570:0:14449:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158220416 00010000:00010000:2.0:1790710985.488672:0:14449:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281572131 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000899 expref: 6 pid: 14465 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710985.488720:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 9 00000100:00100000:2.0:1790710985.488732:0:14449:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff87d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60bc4eeb-e53c-48cd-af53-cb13b58e0a59+6:2359:x1877696158220416:12345-192.168.206.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790710985.488750:0:14449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790710985.488759:0:14449:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281572131 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000899 expref: 6 pid: 14465 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710985.488771:0:14449:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281572131 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000899 expref: 6 pid: 14465 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710985.488799:0:14449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281572131 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000899 expref: 6 pid: 14465 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710985.488817:0:14449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c51d8e33400) 00010000:00010000:2.0:1790710985.488823:0:14449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030400/0xcbad34b2815721cb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710985.488857:0:14449:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030400/0xcbad34b2815721cb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710985.488865:0:14449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030400/0xcbad34b2815721cb lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710985.488900:0:14449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790710985.488967:0:14449:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff87d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60bc4eeb-e53c-48cd-af53-cb13b58e0a59+5:2359:x1877696158220416:12345-192.168.206.46@tcp:103:ldlm_bl.0 Request processed in 236us (1104us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710985.488977:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 9 00010000:00010000:3.0:1790710985.489593:0:16341:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030400/0xcbad34b2815721cb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710985.489928:0:16341:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030400/0xcbad34b2815721cb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710985.489957:0:16341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b2815721d2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710985.489970:0:16341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b2815721d2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710985.489992:0:16341:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b2815721d2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1790710985.494615:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:3.0:1790710985.495962:0:16341:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1790710985.495986:0:16341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030400/0xcbad34b2815721cb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710985.495999:0:16341:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030400/0xcbad34b2815721cb lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710985.496079:0:16341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030400/0xcbad34b2815721cb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710985.496088:0:16341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c0030400 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1790710985.496094:0:16341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030400/0xcbad34b2815721cb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710985.496103:0:16341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030400/0xcbad34b2815721cb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710985.496123:0:16341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c51d8e33400) 00010000:00010000:3.0:1790710985.496271:0:16341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790710985.496326:0:16341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030400/0xcbad34b2815721cb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710985.496333:0:16341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030400/0xcbad34b2815721cb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790710985.496359:0:16341:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000331e6617 reply state 0000000008481f9b transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b2815721d2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710985.496385:0:16341:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790710985.496645:0:16341:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c75de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+10:14401:x1877696158220288:12345-192.168.206.46@tcp:36:lfs.0 Request processed in 13207us (13617us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1790710985.496656:0:16341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 19 00010000:00010000:0.0:1790710985.504033:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b2815721d2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710985.504056:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b2815721d2 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710985.504066:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b2815721d2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710985.504073:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c1645200 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1790710985.504079:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b2815721d2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710985.504088:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b2815721d2 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710985.504108:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9c51d8eb0600) 00010000:00010000:0.0:1790710985.504112:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790710985.504118:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b2815721d2 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710985.504171:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b2815721d2 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710985.598519:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710985.598932:0:14466:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158220544 00000100:00100000:0.0:1790710985.598962:0:14466:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158220544 00000100:00100000:0.0:1790710985.599041:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 20 00000100:00100000:0.0:1790710985.599052:0:14466:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c75dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+9:14409:x1877696158220544:12345-192.168.206.46@tcp:101:lctl.0 00010000:00010000:0.0:1790710985.599084:0:14466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790710985.599113:0:14466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031000/0xcbad34b2815721d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b0570008c3 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710985.599243:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030e00/0xcbad34b2815721e0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710985.599260:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030e00/0xcbad34b2815721e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710985.599273:0:14466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030e00/0xcbad34b2815721e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790710985.599319:0:14466:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1790710985.599378:0:14466:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790710985.599431:0:14466:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030e00/0xcbad34b2815721e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710985.599461:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031000/0xcbad34b2815721d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570008c3 expref: 11 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710985.599484:0:14466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030e00/0xcbad34b2815721e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570008c3 expref: 10 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710985.599494:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c51c7c52a00) 00010000:00010000:0.0:1790710985.599497:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790710985.599502:0:14466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c0030e00, rc 0) 00000100:00100000:0.0:1790710985.599665:0:14466:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c75dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+10:14409:x1877696158220544:12345-192.168.206.46@tcp:101:lctl.0 Request processed in 613us (1159us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710985.599674:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 20 00000100:00100000:1.0:1790710985.628984:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710985.629813:0:14464:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158220672 00000100:00100000:3.0:1790710985.629827:0:14464:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158220672 00000100:00100000:3.0:1790710985.632036:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 21 00000100:00100000:3.0:1790710985.632067:0:14464:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8e8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60bc4eeb-e53c-48cd-af53-cb13b58e0a59+5:14410:x1877696158220672:12345-192.168.206.46@tcp:101:lfs.0 00010000:00010000:3.0:1790710985.632098:0:14464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790710985.632143:0:14464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b2815721e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b0570008ca expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710985.632250:0:14464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645e00/0xcbad34b2815721ee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710985.632269:0:14464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645e00/0xcbad34b2815721ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710985.632283:0:14464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645e00/0xcbad34b2815721ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790710985.632347:0:14464:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790710985.632351:0:14464:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790710985.632376:0:14464:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645e00/0xcbad34b2815721ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710985.632518:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b2815721e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570008ca expref: 7 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710985.632571:0:14464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645e00/0xcbad34b2815721ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570008ca expref: 6 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710985.632581:0:14464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c51c7c52a00) 00010000:00010000:3.0:1790710985.632584:0:14464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790710985.632588:0:14464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c1645e00, rc 0) 00000100:00100000:3.0:1790710985.632684:0:14464:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8e8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60bc4eeb-e53c-48cd-af53-cb13b58e0a59+6:14410:x1877696158220672:12345-192.168.206.46@tcp:101:lfs.0 Request processed in 634us (3714us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710985.632691:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 21 00000100:00100000:0.0:1790710985.636962:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710985.637070:0:14466:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158220800 00000100:00100000:1.0:1790710985.637083:0:14466:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158220800 00000100:00100000:1.0:1790710985.637241:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 22 00000100:00100000:1.0:1790710985.637266:0:14466:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c50c35b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60bc4eeb-e53c-48cd-af53-cb13b58e0a59+6:14410:x1877696158220800:12345-192.168.206.46@tcp:101:lfs.0 00010000:00010000:1.0:1790710985.637298:0:14466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790710985.637353:0:14466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ff135800/0xcbad34b2815721f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b0570008d1 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710985.637447:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ff135e00/0xcbad34b2815721fc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710985.637464:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ff135e00/0xcbad34b2815721fc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710985.637476:0:14466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ff135e00/0xcbad34b2815721fc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710985.637492:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ff135a00/0xcbad34b281572203 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710985.637499:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ff135a00/0xcbad34b281572203 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710985.637506:0:14466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ff135a00/0xcbad34b281572203 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710985.637631:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ff135c00/0xcbad34b28157220a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710985.637640:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ff135c00/0xcbad34b28157220a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710985.637648:0:14466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ff135c00/0xcbad34b28157220a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790710985.637685:0:14466:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1790710985.637689:0:14466:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790710985.637714:0:14466:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ff135c00/0xcbad34b28157220a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710985.637735:0:14466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ff135e00/0xcbad34b2815721fc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710985.637742:0:14466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ff135e00/0xcbad34b2815721fc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710985.637751:0:14466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ff135e00/0xcbad34b2815721fc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710985.637757:0:14466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51ff135e00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1790710985.637763:0:14466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ff135e00/0xcbad34b2815721fc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710985.637772:0:14466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ff135e00/0xcbad34b2815721fc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710985.637788:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c51c7c52a00) 00010000:00010000:1.0:1790710985.637791:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790710985.637797:0:14466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ff135e00/0xcbad34b2815721fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710985.637803:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ff135e00/0xcbad34b2815721fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710985.637817:0:14466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ff135a00/0xcbad34b281572203 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710985.637823:0:14466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ff135a00/0xcbad34b281572203 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710985.637829:0:14466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ff135a00/0xcbad34b281572203 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710985.637841:0:14466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51ff135a00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1790710985.637844:0:14466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ff135a00/0xcbad34b281572203 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710985.637850:0:14466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ff135a00/0xcbad34b281572203 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710985.637859:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9c51d8e33900) 00010000:00010000:1.0:1790710985.637862:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790710985.637865:0:14466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ff135a00/0xcbad34b281572203 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710985.637871:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ff135a00/0xcbad34b281572203 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710985.637909:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ff135800/0xcbad34b2815721f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570008d1 expref: 8 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710985.637924:0:14466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ff135c00/0xcbad34b28157220a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570008d1 expref: 7 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710985.637931:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c51d8e33700) 00010000:00010000:1.0:1790710985.637934:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790710985.637936:0:14466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51ff135c00, rc 0) 00000100:00100000:1.0:1790710985.638019:0:14466:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c50c35b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60bc4eeb-e53c-48cd-af53-cb13b58e0a59+7:14410:x1877696158220800:12345-192.168.206.46@tcp:101:lfs.0 Request processed in 767us (1070us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710985.638027:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 22 00000100:00100000:1.0:1790710985.641821:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710985.642164:0:16341:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158221056 00000100:00100000:0.0:1790710985.642178:0:16341:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158221056 00000100:00100000:0.0:1790710985.642272:0:16341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 23 00000100:00100000:0.0:1790710985.642284:0:16341:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8e8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60bc4eeb-e53c-48cd-af53-cb13b58e0a59+7:14410:x1877696158221056:12345-192.168.206.46@tcp:101:lfs.0 00010000:00010000:0.0:1790710985.642312:0:16341:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790710985.642338:0:16341:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031000/0xcbad34b281572211 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b0570008d8 expref: -99 pid: 16341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790710985.642743:0:16341:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1790710985.642900:0:16341:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031000/0xcbad34b281572211 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570008d8 expref: 9 pid: 16341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710985.642916:0:16341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c51c7c52a00) 00010000:00010000:0.0:1790710985.642920:0:16341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790710985.642925:0:16341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031000/0xcbad34b281572211 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570008d8 expref: 9 pid: 16341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710985.643015:0:16341:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c0031000, rc 0) 00000100:00100000:0.0:1790710985.643232:0:16341:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8e8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60bc4eeb-e53c-48cd-af53-cb13b58e0a59+8:14410:x1877696158221056:12345-192.168.206.46@tcp:101:lfs.0 Request processed in 949us (1422us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1790710985.643242:0:16341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 23 00000100:00100000:3.0:1790710985.650341:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710985.650497:0:14465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158221312 00000100:00100000:0.0:1790710985.650511:0:14465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158221312 00000100:00100000:0.0:1790710985.650617:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 24 00000100:00100000:0.0:1790710985.650629:0:14465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c75dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60bc4eeb-e53c-48cd-af53-cb13b58e0a59+8:14410:x1877696158221312:12345-192.168.206.46@tcp:36:lfs.0 00010000:00010000:0.0:1790710985.650704:0:14465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790710985.650738:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ff135c00/0xcbad34b28157220a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570008d1 expref: 8 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710985.650760:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c51d8e33700) 00010000:00010000:0.0:1790710985.650908:0:14465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790710985.650950:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031a00/0xcbad34b28157221f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710985.650974:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031a00/0xcbad34b28157221f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710985.650986:0:14465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031a00/0xcbad34b28157221f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790710985.651558:0:14465:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000fab34123 reply state 00000000f93ccc1b transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031a00/0xcbad34b28157221f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710985.651571:0:14465:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1790710985.651581:0:14465:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1790710985.651736:0:14465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c75dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60bc4eeb-e53c-48cd-af53-cb13b58e0a59+9:14410:x1877696158221312:12345-192.168.206.46@tcp:36:lfs.0 Request processed in 1107us (1406us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1790710985.651745:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 24 00010000:00010000:1.0:1790710985.655974:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031a00/0xcbad34b28157221f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710985.655998:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031a00/0xcbad34b28157221f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710985.656007:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031a00/0xcbad34b28157221f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710985.656013:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c0031a00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1790710985.656019:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031a00/0xcbad34b28157221f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710985.656028:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031a00/0xcbad34b28157221f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710985.656049:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c51c7c52700) 00010000:00010000:1.0:1790710985.656052:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1790710985.656057:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031a00/0xcbad34b28157221f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710985.656063:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031a00/0xcbad34b28157221f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710985.657885:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710985.658113:0:14467:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158221568 00000100:00100000:0.0:1790710985.658165:0:14467:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158221568 00000100:00100000:0.0:1790710985.658239:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 2 00000100:00100000:0.0:1790710985.658250:0:14467:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c75df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60bc4eeb-e53c-48cd-af53-cb13b58e0a59+8:14410:x1877696158221568:12345-192.168.206.46@tcp:35:lfs.0 00000100:00100000:0.0:1790710985.658603:0:14467:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c75df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60bc4eeb-e53c-48cd-af53-cb13b58e0a59+9:14410:x1877696158221568:12345-192.168.206.46@tcp:35:lfs.0 Request processed in 353us (728us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1790710985.658612:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 2 00000100:00100000:0.0:1790710985.664715:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710985.665054:0:14464:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158221824 00000100:00100000:3.0:1790710985.665067:0:14464:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158221824 00000100:00100000:3.0:1790710985.665171:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 25 00000100:00100000:3.0:1790710985.665184:0:14464:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c50c35b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60bc4eeb-e53c-48cd-af53-cb13b58e0a59+9:14410:x1877696158221824:12345-192.168.206.46@tcp:101:lfs.0 00010000:00010000:3.0:1790710985.665224:0:14464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790710985.665249:0:14464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b281572226 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b0570008df expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710985.665342:0:14464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1644a00/0xcbad34b28157222d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710985.665360:0:14464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1644a00/0xcbad34b28157222d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710985.665376:0:14464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1644a00/0xcbad34b28157222d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710985.665429:0:14464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281572234 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710985.665437:0:14464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281572234 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710985.665445:0:14464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281572234 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790710985.665582:0:14464:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1790710985.665685:0:14464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1644a00/0xcbad34b28157222d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710985.665694:0:14464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1644a00/0xcbad34b28157222d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710985.665701:0:14464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1644a00/0xcbad34b28157222d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710985.665708:0:14464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c1644a00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1790710985.665713:0:14464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1644a00/0xcbad34b28157222d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710985.665722:0:14464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1644a00/0xcbad34b28157222d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710985.665734:0:14464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c51c7c52a00) 00010000:00010000:3.0:1790710985.665738:0:14464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790710985.665742:0:14464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1644a00/0xcbad34b28157222d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710985.665758:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1644a00/0xcbad34b28157222d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710985.665771:0:14464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281572234 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710985.665777:0:14464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281572234 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710985.665783:0:14464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281572234 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710985.665788:0:14464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c1645200 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1790710985.665791:0:14464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281572234 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710985.665798:0:14464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281572234 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710985.665805:0:14464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9c51d8eb0900) 00010000:00010000:3.0:1790710985.665808:0:14464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790710985.665810:0:14464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281572234 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710985.665816:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645200/0xcbad34b281572234 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710985.665859:0:14464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b281572226 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570008df expref: 11 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710985.665881:0:14464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c51c7c52a00) 00010000:00010000:3.0:1790710985.665884:0:14464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790710985.665888:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c1645c00/0xcbad34b281572226 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570008df expref: 11 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710985.665898:0:14464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c1645c00, rc 0) 00000100:00100000:3.0:1790710985.665986:0:14464:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c50c35b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60bc4eeb-e53c-48cd-af53-cb13b58e0a59+10:14410:x1877696158221824:12345-192.168.206.46@tcp:101:lfs.0 Request processed in 805us (1284us total) trans 8589934598 rc 301/301 00000100:00100000:3.0:1790710985.665996:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 25 00000100:00100000:1.0:1790710985.672378:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710985.673672:0:14466:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158221952 00000100:00100000:0.0:1790710985.673693:0:14466:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158221952 00000100:00100000:0.0:1790710985.673872:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 26 00000100:00100000:0.0:1790710985.673887:0:14466:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8e8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60bc4eeb-e53c-48cd-af53-cb13b58e0a59+10:14410:x1877696158221952:12345-192.168.206.46@tcp:101:lfs.0 00010000:00010000:0.0:1790710985.673922:0:14466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790710985.673975:0:14466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031000/0xcbad34b281572242 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b0570008e6 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710985.674100:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031a00/0xcbad34b281572249 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710985.674120:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031a00/0xcbad34b281572249 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710985.674167:0:14466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031a00/0xcbad34b281572249 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790710985.674209:0:14466:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1790710985.674214:0:14466:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790710985.674237:0:14466:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031a00/0xcbad34b281572249 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710985.674270:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031000/0xcbad34b281572242 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570008e6 expref: 12 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710985.674316:0:14466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031a00/0xcbad34b281572249 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570008e6 expref: 11 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710985.674327:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c51c7c52900) 00010000:00010000:0.0:1790710985.674330:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790710985.674333:0:14466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c0031a00, rc 0) 00000100:00100000:0.0:1790710985.675105:0:14466:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8e8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60bc4eeb-e53c-48cd-af53-cb13b58e0a59+11:14410:x1877696158221952:12345-192.168.206.46@tcp:101:lfs.0 Request processed in 1213us (2733us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710985.675117:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 26 00000100:00100000:2.0:1790710985.679670:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710985.679873:0:14467:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158222080 00000100:00100000:0.0:1790710985.679887:0:14467:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158222080 00000100:00100000:0.0:1790710985.680086:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 3 00000100:00100000:0.0:1790710985.680099:0:14467:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d03faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60bc4eeb-e53c-48cd-af53-cb13b58e0a59+11:14410:x1877696158222080:12345-192.168.206.46@tcp:37:lfs.0 00000100:00100000:2.0:1790710985.689355:0:14467:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d03faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60bc4eeb-e53c-48cd-af53-cb13b58e0a59+11:14410:x1877696158222080:12345-192.168.206.46@tcp:37:lfs.0 Request processed in 9242us (9682us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710985.689372:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 3 00000100:00100000:2.0:1790710985.698839:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710985.705473:0:14468:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158222336 00000100:00100000:1.0:1790710985.705494:0:14468:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158222336 00000100:00100000:0.0:1790710985.705653:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 4 00000100:00100000:0.0:1790710985.705667:0:14468:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f409d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60bc4eeb-e53c-48cd-af53-cb13b58e0a59+11:14410:x1877696158222336:12345-192.168.206.46@tcp:35:lfs.0 00000100:00100000:0.0:1790710985.706003:0:14468:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f409d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60bc4eeb-e53c-48cd-af53-cb13b58e0a59+12:14410:x1877696158222336:12345-192.168.206.46@tcp:35:lfs.0 Request processed in 339us (7177us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1790710985.706012:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 4 00000100:00100000:3.0:1790710985.770394:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710985.770523:0:14464:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158222464 00000100:00100000:1.0:1790710985.770545:0:14464:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158222464 00000100:00100000:1.0:1790710985.770631:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 27 00000100:00100000:1.0:1790710985.770643:0:14464:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c75dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+10:14416:x1877696158222464:12345-192.168.206.46@tcp:101:bash.0 00010000:00010000:1.0:1790710985.770675:0:14464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790710985.770719:0:14464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ff135c00/0xcbad34b281572250 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b0570008ed expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710985.770818:0:14464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ff135a00/0xcbad34b281572257 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710985.770851:0:14464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ff135a00/0xcbad34b281572257 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710985.770867:0:14464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ff135a00/0xcbad34b281572257 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710985.770884:0:14464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ff135800/0xcbad34b28157225e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710985.770892:0:14464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ff135800/0xcbad34b28157225e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710985.770900:0:14464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ff135800/0xcbad34b28157225e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710985.771017:0:14464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ff134400/0xcbad34b281572265 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710985.771027:0:14464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ff134400/0xcbad34b281572265 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710985.771035:0:14464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ff134400/0xcbad34b281572265 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790710985.771067:0:14464:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1790710985.771071:0:14464:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790710985.774891:0:14464:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ff134400/0xcbad34b281572265 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710985.774923:0:14464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ff135a00/0xcbad34b281572257 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710985.774933:0:14464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ff135a00/0xcbad34b281572257 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710985.774941:0:14464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ff135a00/0xcbad34b281572257 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710985.774948:0:14464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51ff135a00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1790710985.774954:0:14464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ff135a00/0xcbad34b281572257 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710985.774984:0:14464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ff135a00/0xcbad34b281572257 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710985.775006:0:14464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c51c7c52a00) 00010000:00010000:2.0:1790710985.775010:0:14464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790710985.775016:0:14464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ff135a00/0xcbad34b281572257 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710985.775024:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ff135a00/0xcbad34b281572257 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710985.775049:0:14464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ff135800/0xcbad34b28157225e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710985.775056:0:14464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ff135800/0xcbad34b28157225e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710985.775063:0:14464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ff135800/0xcbad34b28157225e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710985.775068:0:14464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51ff135800 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1790710985.775071:0:14464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ff135800/0xcbad34b28157225e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710985.775077:0:14464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ff135800/0xcbad34b28157225e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710985.775084:0:14464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9c51d8e33900) 00010000:00010000:2.0:1790710985.775087:0:14464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790710985.775335:0:14464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ff135800/0xcbad34b28157225e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710985.775353:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ff135800/0xcbad34b28157225e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710985.775423:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ff135c00/0xcbad34b281572250 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570008ed expref: 12 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710985.775439:0:14464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ff134400/0xcbad34b281572265 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570008ed expref: 11 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710985.775447:0:14464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c51c7c52900) 00010000:00010000:2.0:1790710985.775449:0:14464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1790710985.775452:0:14464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51ff134400, rc 0) 00000100:00100000:2.0:1790710985.775575:0:14464:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c75dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+11:14416:x1877696158222464:12345-192.168.206.46@tcp:101:bash.0 Request processed in 4932us (5203us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710985.775586:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 27 00000100:00100000:1.0:1790710985.781804:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710985.781931:0:14465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158222720 00000100:00100000:2.0:1790710985.781945:0:14465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158222720 00000100:00100000:2.0:1790710985.782032:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 28 00000100:00100000:2.0:1790710985.782044:0:14465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c8e8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+11:14416:x1877696158222720:12345-192.168.206.46@tcp:101:bash.0 00010000:00010000:2.0:1790710985.782070:0:14465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790710985.782097:0:14465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8400/0xcbad34b28157226c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b0570008f4 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710985.782316:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8800/0xcbad34b281572273 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710985.782334:0:14465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031a00/0xcbad34b281572249 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570008e6 expref: 11 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710985.782352:0:14465:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8800/0xcbad34b281572273 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710985.782518:0:14465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031a00/0xcbad34b281572249 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.46@tcp remote: 0x566877b0570008e6 expref: 11 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710985.782545:0:14465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031a00/0xcbad34b281572249 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570008e6 expref: 11 pid: 14466 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710985.782561:0:14465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51d03f8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14465:1877696177083904:192.168.206.46@tcp:104: 00000100:00100000:2.0:1790710985.782801:0:14465:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51ff9fa000 going to sleep for 11 seconds 00000100:00100000:2.0:1790710985.790511:0:14465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51d03f8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14465:1877696177083904:192.168.206.46@tcp:104: 00010000:00010000:2.0:1790710985.790551:0:14465:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8800/0xcbad34b281572273 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710985.797113:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710985.797398:0:14451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158222848 00000100:00100000:2.0:1790710985.797408:0:14451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158222848 00010000:00010000:2.0:1790710985.797450:0:14451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031a00/0xcbad34b281572249 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570008e6 expref: 12 pid: 14466 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710985.797491:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 10 00000100:00100000:2.0:1790710985.797501:0:14451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f3e75500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60bc4eeb-e53c-48cd-af53-cb13b58e0a59+12:2357:x1877696158222848:12345-192.168.206.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790710985.797516:0:14451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790710985.797522:0:14451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031a00/0xcbad34b281572249 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570008e6 expref: 12 pid: 14466 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710985.797565:0:14451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031a00/0xcbad34b281572249 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570008e6 expref: 12 pid: 14466 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710985.797588:0:14451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031a00/0xcbad34b281572249 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570008e6 expref: 12 pid: 14466 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710985.797604:0:14451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c51c7c52900) 00010000:00010000:2.0:1790710985.797609:0:14451:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8800/0xcbad34b281572273 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710985.797619:0:14451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8800/0xcbad34b281572273 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710985.797626:0:14451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8800/0xcbad34b281572273 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710985.797655:0:14451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790710985.797710:0:14451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f3e75500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60bc4eeb-e53c-48cd-af53-cb13b58e0a59+11:2357:x1877696158222848:12345-192.168.206.46@tcp:103:ldlm_bl.0 Request processed in 210us (605us total) trans 0 rc 0/0 00010000:00010000:0.0:1790710985.798199:0:14465:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8800/0xcbad34b281572273 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710985.798208:0:14465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8800/0xcbad34b281572273 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710985.798236:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031000/0xcbad34b28157227a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710985.798254:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031000/0xcbad34b28157227a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710985.798263:0:14465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031000/0xcbad34b28157227a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710985.799868:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 10 00010000:00010000:0.0:1790710985.801231:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030400/0xcbad34b281572281 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710985.801250:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030400/0xcbad34b281572281 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710985.801261:0:14465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030400/0xcbad34b281572281 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790710985.801273:0:14465:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1790710985.801301:0:14465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8800/0xcbad34b281572273 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710985.801308:0:14465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8800/0xcbad34b281572273 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710985.801315:0:14465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8800/0xcbad34b281572273 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710985.801321:0:14465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51f43f8800 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1790710985.801325:0:14465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8800/0xcbad34b281572273 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710985.801333:0:14465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8800/0xcbad34b281572273 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710985.801364:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c51c7c52900) 00010000:00010000:0.0:1790710985.801366:0:14465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790710985.801371:0:14465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8800/0xcbad34b281572273 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710985.801377:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8800/0xcbad34b281572273 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790710985.801390:0:14465:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000059d8a9b7 reply state 000000003c85a50a transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031000/0xcbad34b28157227a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710985.801399:0:14465:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1790710985.801432:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8400/0xcbad34b28157226c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570008f4 expref: 14 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710985.801525:0:14465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030400/0xcbad34b281572281 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570008f4 expref: 13 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710985.801543:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c51c7c52f00) 00010000:00010000:0.0:1790710985.801546:0:14465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1790710985.801549:0:14465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c0030400, rc 0) 00000100:00100000:0.0:1790710985.801632:0:14465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c8e8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+14:14416:x1877696158222720:12345-192.168.206.46@tcp:101:bash.0 Request processed in 19590us (19842us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1790710985.801652:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 28 00010000:00010000:0.0:1790710985.810063:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031000/0xcbad34b28157227a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710985.810081:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031000/0xcbad34b28157227a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710985.810102:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031000/0xcbad34b28157227a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710985.810108:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c0031000 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1790710985.810112:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031000/0xcbad34b28157227a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710985.810120:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031000/0xcbad34b28157227a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710985.810182:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9c51c7c52700) 00010000:00010000:0.0:1790710985.810186:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790710985.810192:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031000/0xcbad34b28157227a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710985.810198:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031000/0xcbad34b28157227a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710985.815673:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710985.816416:0:16341:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158222976 00000100:00100000:0.0:1790710985.816433:0:16341:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158222976 00000100:00100000:0.0:1790710985.816558:0:16341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 29 00000100:00100000:0.0:1790710985.816569:0:16341:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c75df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+13:14416:x1877696158222976:12345-192.168.206.46@tcp:101:bash.0 00010000:00010000:0.0:1790710985.816590:0:16341:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790710985.816607:0:16341:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031000/0xcbad34b28157228f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b0570008fb expref: -99 pid: 16341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710985.816668:0:16341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281572296 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710985.816702:0:16341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281572296 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710985.816714:0:16341:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281572296 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790710985.816749:0:16341:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1790710985.816753:0:16341:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790710985.816770:0:16341:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281572296 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710985.816779:0:16341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281572296 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710985.816802:0:16341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031000/0xcbad34b28157228f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570008fb expref: 15 pid: 16341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710985.816817:0:16341:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281572296 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570008fb expref: 14 pid: 16341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710985.816825:0:16341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c51c7c52f00) 00010000:00010000:0.0:1790710985.816828:0:16341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790710985.816831:0:16341:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c0030000, rc 0) 00000100:00100000:0.0:1790710985.816889:0:16341:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c75df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+14:14416:x1877696158222976:12345-192.168.206.46@tcp:101:bash.0 Request processed in 323us (1230us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710985.816897:0:16341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 29 00000100:00100000:1.0:1790710985.823455:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710985.823574:0:14468:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158223232 00000100:00100000:0.0:1790710985.823583:0:14468:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158223232 00000100:00100000:0.0:1790710985.824918:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 5 00000100:00100000:0.0:1790710985.824950:0:14468:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f3e77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+14:14416:x1877696158223232:12345-192.168.206.46@tcp:35:bash.0 00000100:00100000:0.0:1790710985.825421:0:14468:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f3e77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+15:14416:x1877696158223232:12345-192.168.206.46@tcp:35:bash.0 Request processed in 478us (1974us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1790710985.825430:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 5 00010000:00010000:1.0:1790710985.864281:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790710985.948388:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710985.949383:0:14466:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158223488 00000100:00100000:0.0:1790710985.949396:0:14466:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158223488 00000100:00100000:0.0:1790710985.949470:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 30 00000100:00100000:0.0:1790710985.949481:0:14466:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f3e75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+15:14426:x1877696158223488:12345-192.168.206.46@tcp:101:lfs.0 00010000:00010000:0.0:1790710985.949514:0:14466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790710985.949545:0:14466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031000/0xcbad34b28157229d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b057000902 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790710985.949645:0:14466:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1790710985.949757:0:14466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031000/0xcbad34b28157229d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000902 expref: 17 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710985.949905:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c51c7c52a00) 00010000:00010000:0.0:1790710985.949908:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790710985.949914:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031000/0xcbad34b28157229d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000902 expref: 17 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710985.949930:0:14466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c0031000, rc 0) 00000100:00100000:0.0:1790710985.950003:0:14466:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f3e75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+16:14426:x1877696158223488:12345-192.168.206.46@tcp:101:lfs.0 Request processed in 524us (1625us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1790710985.950010:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 30 00000100:00100000:3.0:1790710985.956310:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710985.959235:0:14467:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158223744 00000100:00100000:2.0:1790710985.959255:0:14467:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158223744 00000100:00100000:2.0:1790710985.959800:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 6 00000100:00100000:2.0:1790710985.959816:0:14467:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c75dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+16:14426:x1877696158223744:12345-192.168.206.46@tcp:35:lfs.0 00000100:00100000:2.0:1790710985.960203:0:14467:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c75dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+17:14426:x1877696158223744:12345-192.168.206.46@tcp:35:lfs.0 Request processed in 389us (3907us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1790710985.960212:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 6 00000100:00100000:1.0:1790710986.009224:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710986.009363:0:14464:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158224000 00000100:00100000:2.0:1790710986.009376:0:14464:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158224000 00000100:00100000:2.0:1790710986.009453:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 31 00000100:00100000:2.0:1790710986.009464:0:14464:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f3e76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+17:14429:x1877696158224000:12345-192.168.206.46@tcp:101:lfs.0 00010000:00010000:2.0:1790710986.009496:0:14464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790710986.009521:0:14464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9a00/0xcbad34b2815722ab lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b057000909 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710986.009657:0:14464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8c00/0xcbad34b2815722b2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710986.009675:0:14464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8c00/0xcbad34b2815722b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710986.009689:0:14464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8c00/0xcbad34b2815722b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790710986.009702:0:14464:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1790710986.009898:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9a00/0xcbad34b2815722ab lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000909 expref: 20 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710986.009920:0:14464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8c00/0xcbad34b2815722b2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000909 expref: 19 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710986.009929:0:14464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c51c7c52f00) 00010000:00010000:2.0:1790710986.009933:0:14464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790710986.009937:0:14464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51f43f8c00, rc 0) 00000100:00100000:2.0:1790710986.010019:0:14464:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f3e76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+19:14429:x1877696158224000:12345-192.168.206.46@tcp:101:lfs.0 Request processed in 556us (808us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1790710986.010037:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 31 00000100:00100000:1.0:1790710986.014931:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710986.015102:0:14450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158224128 00000100:00100000:0.0:1790710986.015167:0:14450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158224128 00000100:00100000:0.0:1790710986.015237:0:14450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 0 00000100:00100000:0.0:1790710986.015249:0:14450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f3e77480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+19:2357:x1877696158224128:12345-192.168.206.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790710986.015269:0:14450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790710986.015299:0:14450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8c00/0xcbad34b2815722b2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000909 expref: 19 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710986.015322:0:14450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c51c7c52f00) 00010000:00010000:0.0:1790710986.015328:0:14450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790710986.015407:0:14450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f3e77480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+18:2357:x1877696158224128:12345-192.168.206.46@tcp:103:ldlm_bl.0 Request processed in 159us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710986.015415:0:14450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 0 00000100:00100000:3.0:1790710986.017616:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710986.017951:0:14466:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158224256 00000100:00100000:0.0:1790710986.017964:0:14466:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158224256 00000100:00100000:0.0:1790710986.018031:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 32 00000100:00100000:0.0:1790710986.018042:0:14466:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51c75df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+18:14429:x1877696158224256:12345-192.168.206.46@tcp:54:lfs.0 00010000:00010000:0.0:1790710986.018143:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031000/0xcbad34b2815722c0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710986.018173:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031000/0xcbad34b2815722c0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710986.018187:0:14466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031000/0xcbad34b2815722c0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710986.018219:0:14466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031000/0xcbad34b2815722c0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710986.018227:0:14466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031000/0xcbad34b2815722c0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710986.018246:0:14466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031000/0xcbad34b2815722c0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710986.018252:0:14466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c0031000 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1790710986.018257:0:14466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031000/0xcbad34b2815722c0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710986.018265:0:14466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031000/0xcbad34b2815722c0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710986.018279:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c51c7c52f00) 00010000:00010000:0.0:1790710986.018283:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790710986.018288:0:14466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031000/0xcbad34b2815722c0 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710986.018300:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031000/0xcbad34b2815722c0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710986.018415:0:14466:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51c75df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+18:14429:x1877696158224256:12345-192.168.206.46@tcp:54:lfs.0 Request processed in 375us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710986.018423:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 32 00000100:00100000:2.0:1790710986.023924:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710986.024251:0:14468:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158224512 00000100:00100000:0.0:1790710986.024265:0:14468:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158224512 00000100:00100000:0.0:1790710986.024363:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 7 00000100:00100000:0.0:1790710986.024374:0:14468:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d03f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+18:14429:x1877696158224512:12345-192.168.206.46@tcp:35:lfs.0 00000100:00100000:0.0:1790710986.024707:0:14468:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d03f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+19:14429:x1877696158224512:12345-192.168.206.46@tcp:35:lfs.0 Request processed in 332us (792us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1790710986.024716:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 7 00000040:00080000:2.0:1790710986.186652:0:14496:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1790710986.285748:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710986.285872:0:14464:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158224768 00000100:00100000:2.0:1790710986.285886:0:14464:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158224768 00000100:00100000:2.0:1790710986.285965:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 33 00000100:00100000:2.0:1790710986.285976:0:14464:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f3e77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+19:14460:x1877696158224768:12345-192.168.206.46@tcp:101:cat.0 00010000:00010000:2.0:1790710986.286019:0:14464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790710986.286045:0:14464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9a00/0xcbad34b2815722c7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b057000910 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710986.286215:0:14464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8200/0xcbad34b2815722ce lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710986.286233:0:14464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8200/0xcbad34b2815722ce lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710986.286247:0:14464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8200/0xcbad34b2815722ce lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790710986.286261:0:14464:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1790710986.286436:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9a00/0xcbad34b2815722c7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000910 expref: 22 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710986.286458:0:14464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8200/0xcbad34b2815722ce lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000910 expref: 21 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710986.286468:0:14464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c51c7c52f00) 00010000:00010000:2.0:1790710986.286486:0:14464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790710986.286491:0:14464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51f43f8200, rc 0) 00000100:00100000:2.0:1790710986.286590:0:14464:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f3e77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+21:14460:x1877696158224768:12345-192.168.206.46@tcp:101:cat.0 Request processed in 615us (855us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1790710986.286597:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 33 00000100:00100000:3.0:1790710986.291626:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710986.291672:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710986.291837:0:14467:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158225152 00000100:00100000:0.0:1790710986.291850:0:14467:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158225152 00000100:00100000:0.0:1790710986.291916:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 8 00000100:00100000:0.0:1790710986.291926:0:14467:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+21:14460:x1877696158225152:12345-192.168.206.46@tcp:35:cat.0 00000100:00100000:0.0:1790710986.292412:0:14467:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+22:14460:x1877696158225152:12345-192.168.206.46@tcp:35:cat.0 Request processed in 483us (736us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1790710986.292421:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 8 00000100:00100000:2.0:1790710986.292718:0:14451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158224896 00000100:00100000:2.0:1790710986.292725:0:14451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158224896 00000100:00100000:2.0:1790710986.292780:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 1 00000100:00100000:2.0:1790710986.292790:0:14451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d5f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+22:2357:x1877696158224896:12345-192.168.206.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790710986.292804:0:14451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790710986.292833:0:14451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8200/0xcbad34b2815722ce lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000910 expref: 22 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710986.292854:0:14451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c51c7c52f00) 00010000:00010000:2.0:1790710986.292860:0:14451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790710986.292887:0:14451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d5f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+21:2357:x1877696158224896:12345-192.168.206.46@tcp:103:ldlm_bl.0 Request processed in 99us (1273us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710986.292894:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 1 00000100:00100000:1.0:1790710986.356342:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710986.356458:0:14466:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158225408 00000100:00100000:0.0:1790710986.356471:0:14466:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158225408 00000100:00100000:0.0:1790710986.356605:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 34 00000100:00100000:0.0:1790710986.356617:0:14466:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f3e76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+21:14466:x1877696158225408:12345-192.168.206.46@tcp:101:dd.0 00010000:00010000:0.0:1790710986.356648:0:14466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790710986.356670:0:14466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031000/0xcbad34b2815722dc lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b057000917 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710986.356914:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031a00/0xcbad34b2815722e3 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710986.356933:0:14466:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030400/0xcbad34b281572281 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570008f4 expref: 22 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710986.356942:0:14466:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281572296 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b0570008fb expref: 22 pid: 16341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710986.356951:0:14466:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031a00/0xcbad34b2815722e3 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710986.356995:0:14466:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281572296 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.46@tcp remote: 0x566877b0570008fb expref: 22 pid: 16341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710986.357096:0:14466:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281572296 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570008fb expref: 22 pid: 16341 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710986.357112:0:14466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c50c35b0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14466:1877696177084032:192.168.206.46@tcp:104: 00010000:00010000:0.0:1790710986.357484:0:14466:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030400/0xcbad34b281572281 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.46@tcp remote: 0x566877b0570008f4 expref: 22 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710986.357496:0:14466:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030400/0xcbad34b281572281 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570008f4 expref: 22 pid: 14465 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710986.357506:0:14466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c50c35b2680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14466:1877696177084160:192.168.206.46@tcp:104: 00000100:00100000:0.0:1790710986.357554:0:14466:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c7bff300 going to sleep for 11 seconds 00000100:00100000:1.0:1790710986.362400:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710986.362449:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710986.362558:0:14449:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158225536 00000100:00100000:2.0:1790710986.362576:0:14449:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158225536 00010000:00010000:2.0:1790710986.362645:0:14449:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281572296 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570008fb expref: 23 pid: 16341 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710986.362708:0:14449:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158225664 00000100:00100000:2.0:1790710986.362712:0:14449:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158225664 00010000:00010000:2.0:1790710986.362726:0:14449:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030400/0xcbad34b281572281 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570008f4 expref: 24 pid: 14465 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710986.362774:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 11 00000100:00100000:2.0:1790710986.362783:0:14449:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f418a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+24:2357:x1877696158225536:12345-192.168.206.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790710986.362816:0:14449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790710986.362825:0:14449:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281572296 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570008fb expref: 24 pid: 16341 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710986.362841:0:14449:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281572296 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570008fb expref: 24 pid: 16341 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710986.362869:0:14449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c51c7c52f00) 00010000:00010000:2.0:1790710986.362875:0:14449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031a00/0xcbad34b2815722e3 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710986.362886:0:14449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031a00/0xcbad34b2815722e3 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710986.362893:0:14449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790710986.362919:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281572296 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570008fb expref: 24 pid: 16341 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710986.362971:0:14451:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1790710986.362972:0:14449:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f418a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+24:2357:x1877696158225536:12345-192.168.206.46@tcp:103:ldlm_bl.0 Request processed in 187us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710986.362991:0:14451:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1790710986.362992:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 11 00000100:00100000:0.0:1790710986.363072:0:14466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c50c35b0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14466:1877696177084032:192.168.206.46@tcp:104: 00000100:00100000:1.0:1790710986.363164:0:14450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 12 00000100:00100000:1.0:1790710986.363179:0:14450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f3e76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+23:2357:x1877696158225664:12345-192.168.206.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790710986.363198:0:14450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1790710986.363203:0:14466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c50c35b2680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14466:1877696177084160:192.168.206.46@tcp:104: 00010000:00010000:1.0:1790710986.363209:0:14450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030400/0xcbad34b281572281 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570008f4 expref: 23 pid: 14465 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710986.363226:0:14450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030400/0xcbad34b281572281 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570008f4 expref: 23 pid: 14465 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710986.363250:0:14450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030400/0xcbad34b281572281 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.46@tcp remote: 0x566877b0570008f4 expref: 22 pid: 14465 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710986.363264:0:14450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c51c7c52f00) 00010000:00010000:1.0:1790710986.363269:0:14450:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031a00/0xcbad34b2815722e3 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710986.363279:0:14450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031a00/0xcbad34b2815722e3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50290000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710986.363304:0:14450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031a00/0xcbad34b2815722e3 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50290000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710986.363325:0:14450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790710986.363371:0:14450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f3e76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+21:2357:x1877696158225664:12345-192.168.206.46@tcp:103:ldlm_bl.0 Request processed in 197us (932us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710986.363379:0:14450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 12 00010000:00010000:0.0:1790710986.363453:0:14466:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031a00/0xcbad34b2815722e3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710986.363465:0:14466:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031a00/0xcbad34b2815722e3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710986.363546:0:14466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031a00/0xcbad34b2815722e3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790710986.363578:0:14466:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1790710986.363732:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031000/0xcbad34b2815722dc lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000917 expref: 22 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710986.363763:0:14466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031a00/0xcbad34b2815722e3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000917 expref: 21 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710986.363772:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c51c7c52f00) 00010000:00010000:0.0:1790710986.363775:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790710986.363777:0:14466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c0031a00, rc 0) 00000100:00100000:0.0:1790710986.363808:0:14466:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f3e76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+21:14466:x1877696158225408:12345-192.168.206.46@tcp:101:dd.0 Request processed in 7194us (7481us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1790710986.363816:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 34 00000100:00100000:3.0:1790710986.369322:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710986.369417:0:14464:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158225920 00000100:00100000:2.0:1790710986.369426:0:14464:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158225920 00000100:00100000:2.0:1790710986.369491:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 35 00000100:00100000:2.0:1790710986.369501:0:14464:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+21:14466:x1877696158225920:12345-192.168.206.46@tcp:36:dd.0 00010000:00010000:2.0:1790710986.369746:0:14464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8200/0xcbad34b2815722f1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710986.369778:0:14464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8200/0xcbad34b2815722f1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710986.369790:0:14464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8200/0xcbad34b2815722f1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790710986.369961:0:14464:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1790710986.369997:0:14464:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000005050a78c reply state 000000007b2ff8d8 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8200/0xcbad34b2815722f1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710986.370006:0:14464:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790710986.370089:0:14464:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+24:14466:x1877696158225920:12345-192.168.206.46@tcp:36:dd.0 Request processed in 589us (774us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1790710986.370096:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 35 00000020:00080000:2.0:1790710986.370100:0:14464:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1790710986.374251:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8200/0xcbad34b2815722f1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710986.374269:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8200/0xcbad34b2815722f1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710986.374276:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8200/0xcbad34b2815722f1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710986.374282:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51f43f8200 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1790710986.374287:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8200/0xcbad34b2815722f1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710986.374294:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8200/0xcbad34b2815722f1 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710986.374308:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c51c7c52f00) 00010000:00010000:1.0:1790710986.374311:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790710986.374315:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8200/0xcbad34b2815722f1 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710986.374320:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8200/0xcbad34b2815722f1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710986.377041:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710986.378331:0:14465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158226048 00000100:00100000:2.0:1790710986.378342:0:14465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158226048 00000100:00100000:2.0:1790710986.378560:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 36 00000100:00100000:2.0:1790710986.378584:0:14465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+23:14466:x1877696158226048:12345-192.168.206.46@tcp:101:dd.0 00010000:00010000:2.0:1790710986.378618:0:14465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790710986.378638:0:14465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9a00/0xcbad34b2815722f8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b05700091e expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710986.378698:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9a00/0xcbad34b2815722f8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700091e expref: 24 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710986.378713:0:14465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9a00/0xcbad34b2815722f8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700091e expref: 24 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710986.378753:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c51c7c52f00) 00010000:00010000:2.0:1790710986.378757:0:14465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790710986.378761:0:14465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51f43f9a00, rc 0) 00000100:00100000:2.0:1790710986.378842:0:14465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+24:14466:x1877696158226048:12345-192.168.206.46@tcp:101:dd.0 Request processed in 267us (1803us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710986.378849:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 36 00000100:00100000:3.0:1790710986.396826:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710986.399527:0:14449:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158226304 00000100:00100000:2.0:1790710986.399552:0:14449:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158226304 00000100:00100000:2.0:1790710986.400119:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 2 00000100:00100000:2.0:1790710986.400150:0:14449:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+24:14466:x1877696158226304:12345-192.168.206.46@tcp:103:dd.0 00010000:00010000:2.0:1790710986.400167:0:14449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790710986.400191:0:14449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9a00/0xcbad34b2815722f8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700091e expref: 24 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710986.400209:0:14449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c51c7c52f00) 00010000:00010000:2.0:1790710986.400213:0:14449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790710986.404651:0:14449:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+23:14466:x1877696158226304:12345-192.168.206.46@tcp:103:dd.0 Request processed in 4511us (7821us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710986.404666:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 2 00000100:00100000:3.0:1790710986.409872:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710986.410083:0:16341:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158226432 00000100:00100000:0.0:1790710986.410095:0:16341:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158226432 00000100:00100000:0.0:1790710986.410194:0:16341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 37 00000100:00100000:0.0:1790710986.410203:0:16341:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+23:14466:x1877696158226432:12345-192.168.206.46@tcp:58:dd.0 00010000:00010000:0.0:1790710986.410297:0:16341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031000/0xcbad34b2815722ff lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710986.410314:0:16341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031000/0xcbad34b2815722ff lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710986.410325:0:16341:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031000/0xcbad34b2815722ff lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790710986.412036:0:16341:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790710986.412278:0:16341:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1790710986.412348:0:16341:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1790710986.412728:0:16341:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+23:14466:x1877696158226432:12345-192.168.206.46@tcp:58:dd.0 Request processed in 2520us (2858us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710986.412740:0:16341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 37 00000100:00100000:1.0:1790710986.416913:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710986.417038:0:14466:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158226560 00000100:00100000:0.0:1790710986.417048:0:14466:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158226560 00000100:00100000:0.0:1790710986.417105:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 38 00000100:00100000:0.0:1790710986.417114:0:14466:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f3e76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+23:14466:x1877696158226560:12345-192.168.206.46@tcp:101:dd.0 00010000:00010000:0.0:1790710986.417168:0:14466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790710986.417187:0:14466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281572306 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b057000925 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710986.417239:0:14466:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031000/0xcbad34b2815722ff lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710986.417250:0:14466:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281572306 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000925 expref: 24 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710986.417269:0:14466:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031000/0xcbad34b2815722ff lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710986.417282:0:14466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281572306 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000925 expref: 24 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710986.417296:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c51c7c52f00) 00010000:00010000:0.0:1790710986.417299:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790710986.417303:0:14466:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281572306 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000925 expref: 24 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710986.417327:0:14466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c0030000, rc 0) 00000100:00100000:0.0:1790710986.417862:0:14466:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f3e76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+24:14466:x1877696158226560:12345-192.168.206.46@tcp:101:dd.0 Request processed in 746us (954us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710986.417870:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 38 00010000:00010000:1.0:1790710986.888294:0:16043:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790710987.207417:0:14496:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1790710987.207427:0:14496:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790710987.207488:0:14496:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1790710987.207494:0:14496:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1790710987.207624:0:14496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51d03fbb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14496:1877696177084288:192.168.206.46@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790710987.207737:0:14496:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51d8a96f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790710987.214353:0:14496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51d03fbb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14496:1877696177084288:192.168.206.46@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790710987.227226:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710987.227639:0:14475:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158226688 00000100:00100000:1.0:1790710987.227649:0:14475:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158226688 00000100:00100000:1.0:1790710987.227724:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 0 00000100:00100000:1.0:1790710987.227737:0:14475:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+24:14467:x1877696158226688:12345-192.168.206.46@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1790710987.227822:0:14475:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+24:14467:x1877696158226688:12345-192.168.206.46@tcp:900:lhsmtool_posix.0 Request processed in 89us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710987.227830:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 0 00000100:00080000:0.0:1790710987.228450:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790710987.232048:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710987.232093:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710987.232179:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710987.232219:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710987.232255:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710987.232281:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710987.232307:0:14457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158226816 00000100:00100000:1.0:1790710987.232317:0:14457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158226816 00000100:00100000:1.0:1790710987.232363:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 120 00000100:00100000:1.0:1790710987.232374:0:14457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f470c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b5b9c20-4564-43be-9f40-bd916384ea36+13:2356:x1877696158226816:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:2.0:1790710987.232541:0:14464:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158227200 00000100:00100000:2.0:1790710987.232546:0:14464:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158227200 00000100:00100000:2.0:1790710987.232588:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 22 00000100:00100000:2.0:1790710987.232597:0:14464:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f3e75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60bc4eeb-e53c-48cd-af53-cb13b58e0a59+11:2356:x1877696158227200:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:0.0:1790710987.232607:0:16041:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158226944 00000100:00100000:0.0:1790710987.232613:0:16041:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158226944 00000100:00100000:0.0:1790710987.232642:0:16041:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158227456 00000100:00100000:0.0:1790710987.232645:0:16041:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158227456 00000100:00100000:0.0:1790710987.232659:0:16041:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158227072 00000100:00100000:0.0:1790710987.232662:0:16041:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158227072 00000100:00100000:2.0:1790710987.232667:0:14464:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f3e75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60bc4eeb-e53c-48cd-af53-cb13b58e0a59+11:2356:x1877696158227200:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 70us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710987.232676:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 22 00000100:00100000:0.0:1790710987.232679:0:16041:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158227328 00000100:00100000:0.0:1790710987.232683:0:16041:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158227328 00000100:00100000:0.0:1790710987.232704:0:16041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 6 00000100:00100000:0.0:1790710987.232711:0:16041:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f3e77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+5:2356:x1877696158226944:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:0.0:1790710987.232745:0:16041:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f3e77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+5:2356:x1877696158226944:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 35us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710987.232751:0:16041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 6 00000100:00100000:0.0:1790710987.232766:0:16041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 7 00000100:00100000:0.0:1790710987.232773:0:16041:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f3e74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60bc4eeb-e53c-48cd-af53-cb13b58e0a59+5:2356:x1877696158227456:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:0.0:1790710987.232802:0:16041:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f3e74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60bc4eeb-e53c-48cd-af53-cb13b58e0a59+5:2356:x1877696158227456:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 30us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710987.232810:0:16041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 7 00000100:00100000:0.0:1790710987.232826:0:16041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 8 00000100:00100000:0.0:1790710987.232834:0:16041:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f3e74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+5:2356:x1877696158227072:12345-192.168.206.46@tcp:400:kworker.0 00000100:00080000:2.0:1790710987.232852:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790710987.232858:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790710987.232861:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790710987.232877:0:15150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 9 00000100:00100000:0.0:1790710987.232885:0:16041:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f3e74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+5:2356:x1877696158227072:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 50us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710987.232891:0:15150:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f3e75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60bc4eeb-e53c-48cd-af53-cb13b58e0a59+5:2356:x1877696158227328:12345-192.168.206.46@tcp:400:kworker.0 00000100:00100000:0.0:1790710987.232899:0:16041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 8 00000100:00100000:2.0:1790710987.232927:0:15150:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f3e75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60bc4eeb-e53c-48cd-af53-cb13b58e0a59+5:2356:x1877696158227328:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 42us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710987.232935:0:15150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 9 00000100:00100000:1.0:1790710987.234642:0:14457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f470c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b5b9c20-4564-43be-9f40-bd916384ea36+13:2356:x1877696158226816:12345-192.168.206.46@tcp:400:kworker.0 Request processed in 2260us (2411us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710987.234656:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 120 00000100:00100000:2.0:1790710987.237657:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710987.237752:0:14465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158227584 00000100:00100000:0.0:1790710987.237761:0:14465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158227584 00000100:00100000:0.0:1790710987.237818:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 39 00000100:00100000:0.0:1790710987.237826:0:14465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d03fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+24:14467:x1877696158227584:12345-192.168.206.46@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1790710987.237854:0:14465:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1790710987.237952:0:14465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d03fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+24:14467:x1877696158227584:12345-192.168.206.46@tcp:53:lhsmtool_posix.0 Request processed in 126us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710987.237959:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 39 00000100:00100000:3.0:1790710987.244022:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710987.249561:0:14464:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158227712 00000100:00100000:2.0:1790710987.249575:0:14464:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158227712 00000100:00100000:2.0:1790710987.249706:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 40 00000100:00100000:2.0:1790710987.249717:0:14464:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+24:14467:x1877696158227712:12345-192.168.206.46@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1790710987.249787:0:14464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9600/0xcbad34b28157230d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710987.249805:0:14464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9600/0xcbad34b28157230d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710987.249836:0:14464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9600/0xcbad34b28157230d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710987.249853:0:14464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9a00/0xcbad34b281572314 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710987.249860:0:14464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9a00/0xcbad34b281572314 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710987.249867:0:14464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9a00/0xcbad34b281572314 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710987.249888:0:14464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8200/0xcbad34b28157231b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710987.249895:0:14464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8200/0xcbad34b28157231b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710987.249901:0:14464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8200/0xcbad34b28157231b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790710987.249937:0:14464:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1790710987.249941:0:14464:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790710987.249953:0:14464:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8200/0xcbad34b28157231b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710987.249962:0:14464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9600/0xcbad34b28157230d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710987.249968:0:14464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9600/0xcbad34b28157230d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710987.249983:0:14464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9600/0xcbad34b28157230d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710987.249989:0:14464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51f43f9600 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1790710987.249992:0:14464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9600/0xcbad34b28157230d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710987.250000:0:14464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9600/0xcbad34b28157230d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710987.250010:0:14464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c51c7c52400) 00010000:00010000:2.0:1790710987.250013:0:14464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790710987.250017:0:14464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9600/0xcbad34b28157230d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710987.250023:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9600/0xcbad34b28157230d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710987.250036:0:14464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9a00/0xcbad34b281572314 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710987.250042:0:14464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9a00/0xcbad34b281572314 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710987.250047:0:14464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9a00/0xcbad34b281572314 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710987.250051:0:14464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51f43f9a00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1790710987.250054:0:14464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9a00/0xcbad34b281572314 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710987.250067:0:14464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9a00/0xcbad34b281572314 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710987.250073:0:14464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9c51cca25100) 00010000:00010000:2.0:1790710987.250076:0:14464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790710987.250078:0:14464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9a00/0xcbad34b281572314 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710987.250084:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9a00/0xcbad34b281572314 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710987.250096:0:14464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8200/0xcbad34b28157231b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710987.250101:0:14464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8200/0xcbad34b28157231b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710987.250107:0:14464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8200/0xcbad34b28157231b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710987.250112:0:14464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51f43f8200 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1790710987.250115:0:14464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8200/0xcbad34b28157231b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710987.250120:0:14464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8200/0xcbad34b28157231b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710987.250126:0:14464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c51c7c52f00) 00010000:00010000:2.0:1790710987.250129:0:14464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790710987.250132:0:14464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8200/0xcbad34b28157231b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710987.250198:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8200/0xcbad34b28157231b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710987.250283:0:14464:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+24:14467:x1877696158227712:12345-192.168.206.46@tcp:34:lhsmtool_posix.0 Request processed in 567us (6268us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710987.250292:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 40 00000100:00100000:3.0:1790710987.255273:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710987.257171:0:16341:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158227968 00000100:00100000:0.0:1790710987.257185:0:16341:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158227968 00000100:00100000:0.0:1790710987.257254:0:16341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 41 00000100:00100000:0.0:1790710987.257264:0:16341:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+24:14467:x1877696158227968:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790710987.257284:0:16341:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790710987.257303:0:16341:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030400/0xcbad34b281572322 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b05700092c expref: -99 pid: 16341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.257414:0:16341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ee716400/0xcbad34b281572329 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.257429:0:16341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ee716400/0xcbad34b281572329 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.257440:0:16341:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ee716400/0xcbad34b281572329 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790710987.257463:0:16341:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1790710987.257564:0:16341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ee716400/0xcbad34b281572329 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.257573:0:16341:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ee716400/0xcbad34b281572329 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.257579:0:16341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ee716400/0xcbad34b281572329 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.257585:0:16341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51ee716400 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1790710987.257589:0:16341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ee716400/0xcbad34b281572329 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.257596:0:16341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ee716400/0xcbad34b281572329 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.257608:0:16341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c51c7c52f00) 00010000:00010000:0.0:1790710987.257612:0:16341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790710987.257615:0:16341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ee716400/0xcbad34b281572329 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.257621:0:16341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ee716400/0xcbad34b281572329 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.257660:0:16341:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030400/0xcbad34b281572322 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700092c expref: 26 pid: 16341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.257670:0:16341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c51c7c52400) 00010000:00010000:0.0:1790710987.257672:0:16341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790710987.257683:0:16341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030400/0xcbad34b281572322 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700092c expref: 26 pid: 16341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.257692:0:16341:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51c0030400, rc 0) 00000100:00100000:0.0:1790710987.257753:0:16341:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+25:14467:x1877696158227968:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 Request processed in 491us (2490us total) trans 8589934611 rc 301/301 00000100:00100000:0.0:1790710987.257761:0:16341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 41 00000100:00100000:1.0:1790710987.262722:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710987.262849:0:16341:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158228096 00000100:00100000:0.0:1790710987.262859:0:16341:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158228096 00000100:00100000:0.0:1790710987.262920:0:16341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 42 00000100:00100000:0.0:1790710987.262930:0:16341:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f3e74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+25:14467:x1877696158228096:12345-192.168.206.46@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1790710987.262968:0:16341:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1790710987.263108:0:16341:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f3e74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+25:14467:x1877696158228096:12345-192.168.206.46@tcp:53:lhsmtool_posix.0 Request processed in 169us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710987.263116:0:16341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 42 00000100:00100000:0.0:1790710987.270798:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710987.270902:0:14464:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158228352 00000100:00100000:2.0:1790710987.270912:0:14464:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158228352 00000100:00100000:2.0:1790710987.270971:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 43 00000100:00100000:2.0:1790710987.270979:0:14464:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c50c35b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+25:14467:x1877696158228352:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790710987.270999:0:14464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790710987.271017:0:14464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8200/0xcbad34b281572337 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b057000933 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790710987.271696:0:14464:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x6:0x0], count =28 00000004:00080000:2.0:1790710987.271703:0:14464:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x6:0x0]+28 in llog 00000004:00080000:2.0:1790710987.271748:0:14464:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:2.0:1790710987.271984:0:14464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9600/0xcbad34b28157233e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710987.271999:0:14464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9600/0xcbad34b28157233e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710987.272011:0:14464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9600/0xcbad34b28157233e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710987.272063:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8200/0xcbad34b281572337 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000933 expref: 28 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710987.272092:0:14464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9600/0xcbad34b28157233e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000933 expref: 27 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710987.272100:0:14464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c51cca25100) 00010000:00010000:2.0:1790710987.272103:0:14464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790710987.272107:0:14464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51f43f9600, rc 0) 00000100:00100000:2.0:1790710987.272218:0:14464:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c50c35b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+27:14467:x1877696158228352:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 Request processed in 1238us (1430us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1790710987.272227:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 43 00000100:00100000:2.0:1790710987.277705:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710987.277897:0:16341:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158228608 00000100:00100000:0.0:1790710987.277906:0:16341:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158228608 00000100:00100000:0.0:1790710987.277966:0:16341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 44 00000100:00100000:0.0:1790710987.277976:0:16341:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d03f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+27:14467:x1877696158228608:12345-192.168.206.46@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790710987.278032:0:16341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790710987.278060:0:16341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f9600/0xcbad34b28157233e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000933 expref: 27 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.278078:0:16341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c51cca25100) 00010000:00010000:0.0:1790710987.278088:0:16341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790710987.278122:0:16341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ee717200/0xcbad34b28157234c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.278193:0:16341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ee717200/0xcbad34b28157234c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.278204:0:16341:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ee717200/0xcbad34b28157234c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.278219:0:16341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ee716a00/0xcbad34b281572353 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd08ea0cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.278225:0:16341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ee716a00/0xcbad34b281572353 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd08ea0cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.278231:0:16341:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ee716a00/0xcbad34b281572353 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd08ea0cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.278678:0:16341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ee717200/0xcbad34b28157234c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.278689:0:16341:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ee717200/0xcbad34b28157234c lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.278696:0:16341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ee717200/0xcbad34b28157234c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.278701:0:16341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51ee717200 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1790710987.278705:0:16341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ee717200/0xcbad34b28157234c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.278712:0:16341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ee717200/0xcbad34b28157234c lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.278733:0:16341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c51c7c52900) 00010000:00010000:0.0:1790710987.278735:0:16341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790710987.278739:0:16341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ee717200/0xcbad34b28157234c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.278745:0:16341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ee717200/0xcbad34b28157234c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.278755:0:16341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ee716a00/0xcbad34b281572353 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd08ea0cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.278760:0:16341:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ee716a00/0xcbad34b281572353 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd08ea0cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.278766:0:16341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ee716a00/0xcbad34b281572353 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd08ea0cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.278771:0:16341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51ee716a00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1790710987.278774:0:16341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ee716a00/0xcbad34b281572353 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd08ea0cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.278779:0:16341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ee716a00/0xcbad34b281572353 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd08ea0cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.278786:0:16341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd08ea0cd (ffff9c51c7c52700) 00010000:00010000:0.0:1790710987.278789:0:16341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790710987.278792:0:16341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ee716a00/0xcbad34b281572353 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd08ea0cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.278798:0:16341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ee716a00/0xcbad34b281572353 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd08ea0cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710987.278900:0:16341:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d03f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+26:14467:x1877696158228608:12345-192.168.206.46@tcp:36:lhsmtool_posix.0 Request processed in 924us (1203us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790710987.278908:0:16341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 44 00000100:00100000:0.0:1790710987.282119:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710987.286090:0:14464:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158228736 00000100:00100000:2.0:1790710987.286116:0:14464:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158228736 00000100:00100000:2.0:1790710987.286213:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 45 00000100:00100000:2.0:1790710987.286224:0:14464:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c50c35b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+26:14467:x1877696158228736:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790710987.286246:0:14464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790710987.286276:0:14464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8200/0xcbad34b28157235a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b05700093a expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710987.286313:0:14464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8c00/0xcbad34b281572361 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710987.286325:0:14464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8c00/0xcbad34b281572361 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710987.286337:0:14464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8c00/0xcbad34b281572361 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710987.286463:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8200/0xcbad34b28157235a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700093a expref: 28 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710987.286483:0:14464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8c00/0xcbad34b281572361 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700093a expref: 27 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710987.286491:0:14464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c51cca25300) 00010000:00010000:2.0:1790710987.286495:0:14464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790710987.286498:0:14464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51f43f8c00, rc 0) 00000100:00100000:2.0:1790710987.286582:0:14464:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c50c35b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+27:14467:x1877696158228736:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 Request processed in 358us (4483us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710987.286589:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 45 00000100:00100000:0.0:1790710987.292560:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710987.293800:0:14466:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158228992 00000100:00100000:1.0:1790710987.293812:0:14466:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158228992 00000100:00100000:1.0:1790710987.293885:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 46 00000100:00100000:1.0:1790710987.293893:0:14466:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c50c35b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+27:14467:x1877696158228992:12345-192.168.206.46@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790710987.293969:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ff134800/0xcbad34b281572368 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710987.293986:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ff134800/0xcbad34b281572368 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710987.293998:0:14466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ff134800/0xcbad34b281572368 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790710987.294657:0:14466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:1.0:1790710987.294668:0:14466:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 464631539505ns, next at 465631537619ns, rc = 0 00000004:00010000:1.0:1790710987.294740:0:14466:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000009fdf7449 reply state 00000000ccbb405f transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ff134800/0xcbad34b281572368 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710987.294750:0:14466:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790710987.294883:0:14466:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c50c35b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+29:14467:x1877696158228992:12345-192.168.206.46@tcp:36:lhsmtool_posix.0 Request processed in 988us (2333us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1790710987.294890:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 46 00010000:00010000:0.0:1790710987.303690:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ff134800/0xcbad34b281572368 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.303707:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ff134800/0xcbad34b281572368 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.303714:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ff134800/0xcbad34b281572368 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.303720:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51ff134800 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1790710987.303724:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ff134800/0xcbad34b281572368 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.303732:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ff134800/0xcbad34b281572368 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.303747:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c51cca25300) 00010000:00010000:0.0:1790710987.303751:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790710987.303755:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ff134800/0xcbad34b281572368 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.303762:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ff134800/0xcbad34b281572368 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710987.306846:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710987.306921:0:14464:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158229120 00000100:00100000:2.0:1790710987.306931:0:14464:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158229120 00000100:00100000:2.0:1790710987.306985:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 47 00000100:00100000:2.0:1790710987.306995:0:14464:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c50c35b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+28:14467:x1877696158229120:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790710987.307021:0:14464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790710987.307044:0:14464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8a00/0xcbad34b28157236f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b057000941 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710987.307120:0:14464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8a00/0xcbad34b28157236f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000941 expref: 29 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710987.307185:0:14464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8a00/0xcbad34b28157236f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000941 expref: 29 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710987.307219:0:14464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c51cca25300) 00010000:00010000:2.0:1790710987.307223:0:14464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790710987.307227:0:14464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51f43f8a00, rc 0) 00000100:00100000:2.0:1790710987.307295:0:14464:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c50c35b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+29:14467:x1877696158229120:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 Request processed in 301us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710987.307301:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 47 00000100:00100000:3.0:1790710987.313882:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710987.313983:0:16041:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158229248 00000100:00100000:0.0:1790710987.313994:0:16041:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158229248 00000100:00100000:0.0:1790710987.314054:0:16041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 10 00000100:00100000:0.0:1790710987.314064:0:16041:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+5:2358:x1877696158229248:12345-192.168.206.46@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1790710987.314608:0:16041:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+6:2358:x1877696158229248:12345-192.168.206.46@tcp:2:lhsmtool_posix.0 Request processed in 544us (734us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1790710987.314616:0:16041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 10 00000100:00100000:3.0:1790710987.317594:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710987.317786:0:14467:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158229504 00000100:00100000:0.0:1790710987.317795:0:14467:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158229504 00000100:00100000:0.0:1790710987.317848:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 9 00000100:00100000:0.0:1790710987.317857:0:14467:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+29:14467:x1877696158229504:12345-192.168.206.46@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1790710987.318087:0:14467:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+30:14467:x1877696158229504:12345-192.168.206.46@tcp:35:lhsmtool_posix.0 Request processed in 229us (499us total) trans 8589934614 rc 0/0 00000100:00100000:0.0:1790710987.318095:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 9 00000100:00100000:3.0:1790710987.320455:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710987.320840:0:16341:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158229760 00000100:00100000:0.0:1790710987.320850:0:16341:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158229760 00000100:00100000:0.0:1790710987.320907:0:16341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 48 00000100:00100000:0.0:1790710987.320916:0:16341:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+30:14467:x1877696158229760:12345-192.168.206.46@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1790710987.321027:0:16341:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+30:14467:x1877696158229760:12345-192.168.206.46@tcp:57:lhsmtool_posix.0 Request processed in 111us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710987.321034:0:16341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 48 00000100:00100000:3.0:1790710987.323708:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710987.324097:0:14464:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158229888 00000100:00100000:2.0:1790710987.324107:0:14464:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158229888 00000100:00100000:2.0:1790710987.324208:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 49 00000100:00100000:2.0:1790710987.324218:0:14464:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+30:14467:x1877696158229888:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790710987.324240:0:14464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790710987.324262:0:14464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8200/0xcbad34b281572376 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b057000948 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710987.324341:0:14464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8400/0xcbad34b28157237d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710987.324363:0:14464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8400/0xcbad34b28157237d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710987.324382:0:14464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8400/0xcbad34b28157237d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790710987.324417:0:14464:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790710987.324434:0:14464:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8400/0xcbad34b28157237d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710987.324460:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8200/0xcbad34b281572376 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000948 expref: 32 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710987.324492:0:14464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8400/0xcbad34b28157237d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000948 expref: 31 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710987.324502:0:14464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c51cca25300) 00010000:00010000:2.0:1790710987.324505:0:14464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1790710987.324508:0:14464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51f43f8400, rc 0) 00000100:00100000:2.0:1790710987.324580:0:14464:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+31:14467:x1877696158229888:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 Request processed in 363us (880us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710987.324587:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 49 00000100:00100000:3.0:1790710987.327567:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710987.327838:0:15149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158230016 00000100:00100000:2.0:1790710987.327848:0:15149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158230016 00000100:00100000:2.0:1790710987.327905:0:15149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 11 00000100:00100000:2.0:1790710987.327914:0:15149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+6:2359:x1877696158230016:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790710987.327933:0:15149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790710987.327953:0:15149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363dfc64/0xcbad34b281572384 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b05700094f expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790710987.327980:0:15149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abc14cb, blocks: 0x1 00010000:00010000:2.0:1790710987.328000:0:15149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=464s v=(0 0) 00010000:00010000:2.0:1790710987.328004:0:15149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790710987.328013:0:15149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000363dfc64/0xcbad34b281572384 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700094f expref: 7 pid: 15149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710987.328031:0:15149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000363dfc64/0xcbad34b281572384 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700094f expref: 7 pid: 15149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710987.328063:0:15149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51f43f8800, rc 0) 00000100:00100000:2.0:1790710987.328119:0:15149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+7:2359:x1877696158230016:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 Request processed in 205us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710987.328164:0:15149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 11 00000100:00100000:3.0:1790710987.331976:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710987.332179:0:16341:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158230272 00000100:00100000:0.0:1790710987.332189:0:16341:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158230272 00000100:00100000:0.0:1790710987.332245:0:16341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 50 00000100:00100000:0.0:1790710987.332254:0:16341:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+31:14467:x1877696158230272:12345-192.168.206.46@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1790710987.332519:0:16341:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+31:14467:x1877696158230272:12345-192.168.206.46@tcp:57:lhsmtool_posix.0 Request processed in 265us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710987.332537:0:16341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 50 00000100:00100000:2.0:1790710987.335612:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710987.335724:0:14464:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158230400 00000100:00100000:3.0:1790710987.335734:0:14464:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158230400 00000100:00100000:2.0:1790710987.335897:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 51 00000100:00100000:2.0:1790710987.335908:0:14464:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d03f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+31:14467:x1877696158230400:12345-192.168.206.46@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1790710987.366088:0:5867:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000001:00080000:3.0:1790710987.366115:0:5867:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000004:00080000:3.0:1790710987.366298:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:2.0:1790710987.366304:0:14464:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d03f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+21:14467:x1877696158230400:12345-192.168.206.46@tcp:44:lhsmtool_posix.0 Request processed in 30394us (30695us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710987.366674:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790710987.366690:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f3e74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1877696177084416:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1790710987.366741:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790710987.366801:0:16041:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177084416 00000100:00100000:1.0:1790710987.366808:0:16041:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177084416 00000100:00100000:1.0:1790710987.366861:0:16041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790710987.366869:0:16041:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f3e75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1877696177084416:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1790710987.368982:0:16041:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1790710987.368992:0:16041:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1790710987.369006:0:16041:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1790710987.369008:0:16041:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1790710987 -> 1790710987 00002000:00010000:1.0:1790710987.369011:0:16041:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1790710987.369085:0:16041:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f3e75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3310:x1877696177084416:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2214us (2341us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1790710987.369096:0:16041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1790710987.369162:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1790710987.369212:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c51f3e74a80/2, rc 0, transno 8589934595 00000100:00100000:1.0:1790710987.369218:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f3e74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1877696177084416:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1790710987.370954:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 51 00000100:00100000:0.0:1790710987.371288:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710987.371405:0:15149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158230528 00000100:00100000:2.0:1790710987.371413:0:15149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158230528 00000100:00100000:2.0:1790710987.371467:0:15149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 13 00000100:00100000:2.0:1790710987.371475:0:15149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c50c35b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+7:2359:x1877696158230528:12345-192.168.206.46@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1790710987.371580:0:15149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c50c35b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+7:2359:x1877696158230528:12345-192.168.206.46@tcp:16:lhsmtool_posix.0 Request processed in 106us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710987.371586:0:15149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 13 00000100:00100000:0.0:1790710987.381940:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710987.384823:0:14466:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158230784 00000100:00100000:1.0:1790710987.384836:0:14466:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158230784 00000100:00100000:0.0:1790710987.386461:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 52 00000100:00100000:0.0:1790710987.386474:0:14466:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c50c35b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+14:14467:x1877696158230784:12345-192.168.206.46@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790710987.386535:0:14466:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790710987.386561:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8400/0xcbad34b28157237d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000948 expref: 14 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.386581:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c51cca25300) 00010000:00010000:0.0:1790710987.386586:0:14466:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790710987.386614:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ee716c00/0xcbad34b28157238b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.386641:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ee716c00/0xcbad34b28157238b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.386652:0:14466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ee716c00/0xcbad34b28157238b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790710987.386836:0:14466:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000de5dcc3b reply state 000000009f20f22b transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ee716c00/0xcbad34b28157238b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710987.386845:0:14466:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790710987.387074:0:14466:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c50c35b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+15:14467:x1877696158230784:12345-192.168.206.46@tcp:36:lhsmtool_posix.0 Request processed in 601us (5140us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1790710987.387100:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 52 00000100:00100000:3.0:1790710987.391596:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00010000:00010000:0.0:1790710987.392155:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ee716c00/0xcbad34b28157238b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.392168:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ee716c00/0xcbad34b28157238b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.392177:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ee716c00/0xcbad34b28157238b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.392182:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51ee716c00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1790710987.392187:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ee716c00/0xcbad34b28157238b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.392194:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ee716c00/0xcbad34b28157238b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.392209:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c51cca25300) 00010000:00010000:0.0:1790710987.392212:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790710987.392216:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ee716c00/0xcbad34b28157238b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.392222:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ee716c00/0xcbad34b28157238b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710987.392712:0:16041:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158230912 00000100:00100000:1.0:1790710987.392722:0:16041:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158230912 00000100:00100000:1.0:1790710987.392780:0:16041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 14 00000100:00100000:1.0:1790710987.392789:0:16041:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+7:14467:x1877696158230912:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790710987.392805:0:16041:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790710987.392821:0:16041:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000775e9b38/0xcbad34b281572392 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x566877b057000956 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710987.392849:0:16041:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000363dfc64/0xcbad34b281572384 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b05700094f expref: 8 pid: 15149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710987.392858:0:16041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790710987.392862:0:16041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790710987.392867:0:16041:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000775e9b38/0xcbad34b281572392 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000956 expref: 8 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710987.392980:0:16041:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000363dfc64/0xcbad34b281572384 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.46@tcp remote: 0x566877b05700094f expref: 8 pid: 15149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710987.392995:0:16041:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000363dfc64/0xcbad34b281572384 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.46@tcp remote: 0x566877b05700094f expref: 8 pid: 15149 timeout: 564 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710987.393075:0:16041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f3e74380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:16041:1877696177084544:192.168.206.46@tcp:104: 00000100:00100000:1.0:1790710987.393632:0:16041:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c3f8c180 going to sleep for 11 seconds 00000100:00100000:1.0:1790710987.396214:0:16041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f3e74380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:16041:1877696177084544:192.168.206.46@tcp:104: 00010000:00010000:1.0:1790710987.396249:0:16041:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000775e9b38/0xcbad34b281572392 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.46@tcp remote: 0x566877b057000956 expref: 8 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710987.396269:0:16041:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c51ff135200, rc 0) 00000100:00100000:1.0:1790710987.396344:0:16041:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+8:14467:x1877696158230912:12345-192.168.206.46@tcp:101:lhsmtool_posix.0 Request processed in 3554us (4754us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710987.396353:0:16041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 14 00000100:00100000:2.0:1790710987.397488:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710987.397565:0:14450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158231040 00000100:00100000:1.0:1790710987.397573:0:14450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158231040 00010000:00010000:1.0:1790710987.397606:0:14450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000363dfc64/0xcbad34b281572384 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.46@tcp remote: 0x566877b05700094f expref: 8 pid: 15149 timeout: 564 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710987.397644:0:14450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 13 00000100:00100000:1.0:1790710987.397661:0:14450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d03f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+8:2359:x1877696158231040:12345-192.168.206.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790710987.397687:0:14450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790710987.397708:0:14450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000363dfc64/0xcbad34b281572384 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.46@tcp remote: 0x566877b05700094f expref: 8 pid: 15149 timeout: 564 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710987.397719:0:14450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000363dfc64/0xcbad34b281572384 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.46@tcp remote: 0x566877b05700094f expref: 8 pid: 15149 timeout: 564 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710987.397740:0:14450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363dfc64/0xcbad34b281572384 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.46@tcp remote: 0x566877b05700094f expref: 8 pid: 15149 timeout: 564 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710987.397755:0:14450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790710987.397759:0:14450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790710987.397765:0:14450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000775e9b38/0xcbad34b281572392 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.206.46@tcp remote: 0x566877b057000956 expref: 7 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710987.397775:0:14450:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000775e9b38/0xcbad34b281572392 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.206.46@tcp remote: 0x566877b057000956 expref: 7 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710987.397808:0:14450:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000775e9b38/0xcbad34b281572392 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.46@tcp remote: 0x566877b057000956 expref: 7 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710987.397821:0:14450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f3e74380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:14450:1877696177084672:192.168.206.46@tcp:105: 00000100:00100000:1.0:1790710987.397888:0:14450:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c3f8c180 going to sleep for 11 seconds 00000100:00100000:1.0:1790710987.401165:0:14450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f3e74380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:14450:1877696177084672:192.168.206.46@tcp:105: 00010000:00010000:1.0:1790710987.401192:0:14450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790710987.401258:0:14450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d03f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+7:2359:x1877696158231040:12345-192.168.206.46@tcp:103:ldlm_bl.0 Request processed in 3606us (3773us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710987.401269:0:14450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 13 00000100:00100000:2.0:1790710987.403934:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710987.404043:0:15149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158231168 00000100:00100000:0.0:1790710987.404054:0:15149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158231168 00000100:00100000:0.0:1790710987.404175:0:15149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 15 00000100:00100000:0.0:1790710987.404186:0:15149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d03fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+7:2358:x1877696158231168:12345-192.168.206.46@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1790710987.404625:0:15149:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1790710987.404641:0:15149:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1790710986 00002000:00010000:0.0:1790710987.404644:0:15149:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1790710985 00002000:00010000:0.0:1790710987.404646:0:15149:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1790710987 -> 1790710986 00002000:00010000:0.0:1790710987.404649:0:15149:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1790710987.404714:0:15149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d03fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+8:2358:x1877696158231168:12345-192.168.206.46@tcp:2:lhsmtool_posix.0 Request processed in 530us (786us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1790710987.404723:0:15149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 15 00000100:00100000:2.0:1790710987.407932:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710987.408030:0:15150:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158231296 00000100:00100000:1.0:1790710987.408039:0:15150:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158231296 00000100:00100000:1.0:1790710987.408095:0:15150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 16 00000100:00100000:1.0:1790710987.408105:0:15150:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d03f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+8:2358:x1877696158231296:12345-192.168.206.46@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1790710987.408502:0:15150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000cfd42d3c/0xcbad34b281572399 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710987.408533:0:15150:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000775e9b38/0xcbad34b281572392 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.46@tcp remote: 0x566877b057000956 expref: 8 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710987.408542:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790710987.408546:0:15150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790710987.408551:0:15150:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cfd42d3c/0xcbad34b281572399 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710987.408585:0:15150:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000775e9b38/0xcbad34b281572392 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.206.46@tcp remote: 0x566877b057000956 expref: 8 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710987.408599:0:15150:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000775e9b38/0xcbad34b281572392 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.206.46@tcp remote: 0x566877b057000956 expref: 8 pid: 16041 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710987.408613:0:15150:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f3e74380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:15150:1877696177084800:192.168.206.46@tcp:104: 00000100:00100000:1.0:1790710987.408732:0:15150:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c3f8c180 going to sleep for 11 seconds 00000100:00100000:1.0:1790710987.412967:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710987.413038:0:14451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158231424 00000100:00100000:3.0:1790710987.413046:0:14451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158231424 00010000:00010000:3.0:1790710987.413089:0:14451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000775e9b38/0xcbad34b281572392 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.46@tcp remote: 0x566877b057000956 expref: 9 pid: 16041 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790710987.413123:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 14 00000100:00100000:3.0:1790710987.413169:0:14451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f3e75500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+9:2359:x1877696158231424:12345-192.168.206.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790710987.413182:0:14451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790710987.413202:0:14451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000775e9b38/0xcbad34b281572392 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.46@tcp remote: 0x566877b057000956 expref: 9 pid: 16041 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710987.413216:0:14451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000775e9b38/0xcbad34b281572392 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.206.46@tcp remote: 0x566877b057000956 expref: 9 pid: 16041 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710987.413239:0:14451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790710987.413244:0:14451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790710987.413249:0:14451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cfd42d3c/0xcbad34b281572399 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710987.413286:0:14451:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cfd42d3c/0xcbad34b281572399 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710987.413308:0:14451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790710987.413364:0:14451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f3e75500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+9:2359:x1877696158231424:12345-192.168.206.46@tcp:103:ldlm_bl.0 Request processed in 196us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710987.413372:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 14 00010000:00010000:2.0:1790710987.414928:0:15150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000775e9b38/0xcbad34b281572392 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.206.46@tcp remote: 0x566877b057000956 expref: 8 pid: 16041 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710987.414964:0:15150:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f3e74380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:15150:1877696177084800:192.168.206.46@tcp:104: 00010000:00010000:2.0:1790710987.414987:0:15150:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cfd42d3c/0xcbad34b281572399 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710987.414997:0:15150:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cfd42d3c/0xcbad34b281572399 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710987.415004:0:15150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cfd42d3c/0xcbad34b281572399 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710987.415032:0:15150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000cfd42d3c/0xcbad34b281572399 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710987.415041:0:15150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cfd42d3c/0xcbad34b281572399 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710987.415050:0:15150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cfd42d3c/0xcbad34b281572399 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710987.415057:0:15150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51ff135c00 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:2.0:1790710987.415061:0:15150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfd42d3c/0xcbad34b281572399 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710987.415071:0:15150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfd42d3c/0xcbad34b281572399 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710987.415094:0:15150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cfd42d3c/0xcbad34b281572399 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710987.415101:0:15150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cfd42d3c/0xcbad34b281572399 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710987.415340:0:15150:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d03f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+7:2358:x1877696158231296:12345-192.168.206.46@tcp:1:lhsmtool_posix.0 Request processed in 7236us (7415us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710987.415350:0:15150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 16 00000100:00100000:1.0:1790710987.418322:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710987.418496:0:14465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158231680 00000100:00100000:0.0:1790710987.418505:0:14465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158231680 00000100:00100000:0.0:1790710987.418569:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 53 00000100:00100000:0.0:1790710987.418579:0:14465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f3e77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+14:14467:x1877696158231680:12345-192.168.206.46@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1790710987.418654:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ee717000/0xcbad34b2815723a0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.418672:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ee717000/0xcbad34b2815723a0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.418683:0:14465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ee717000/0xcbad34b2815723a0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.418904:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ee716200/0xcbad34b2815723a7 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.418916:0:14465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8a00/0xcbad34b28157236f lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000941 expref: 15 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.418924:0:14465:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ee716200/0xcbad34b2815723a7 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.418956:0:14465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8a00/0xcbad34b28157236f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.46@tcp remote: 0x566877b057000941 expref: 15 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.418976:0:14465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8a00/0xcbad34b28157236f lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000941 expref: 15 pid: 14464 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710987.418989:0:14465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c50c35b1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14465:1877696177084928:192.168.206.46@tcp:104: 00000100:00100000:0.0:1790710987.419073:0:14465:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c8e739c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790710987.422640:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:0.0:1790710987.422745:0:14465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c50c35b1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14465:1877696177084928:192.168.206.46@tcp:104: 00010000:00010000:0.0:1790710987.422771:0:14465:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ee716200/0xcbad34b2815723a7 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710987.422841:0:16695:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158231808 00000100:00100000:2.0:1790710987.422848:0:16695:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158231808 00010000:00010000:2.0:1790710987.422882:0:16695:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8a00/0xcbad34b28157236f lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000941 expref: 16 pid: 14464 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790710987.422919:0:16695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 15 00000100:00100000:2.0:1790710987.422929:0:16695:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d5e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+16:2358:x1877696158231808:12345-192.168.206.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790710987.422945:0:16695:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790710987.422951:0:16695:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8a00/0xcbad34b28157236f lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000941 expref: 16 pid: 14464 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710987.422963:0:16695:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8a00/0xcbad34b28157236f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000941 expref: 16 pid: 14464 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710987.422983:0:16695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51f43f8a00/0xcbad34b28157236f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.46@tcp remote: 0x566877b057000941 expref: 16 pid: 14464 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710987.423013:0:16695:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c51cca25300) 00010000:00010000:2.0:1790710987.423017:0:16695:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ee716200/0xcbad34b2815723a7 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710987.423026:0:16695:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ee716200/0xcbad34b2815723a7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710987.423033:0:16695:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ee716200/0xcbad34b2815723a7 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710987.423059:0:16695:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790710987.423112:0:16695:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d5e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+15:2358:x1877696158231808:12345-192.168.206.46@tcp:103:ldlm_bl.0 Request processed in 183us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710987.423119:0:16695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 15 00010000:00010000:0.0:1790710987.423284:0:14465:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ee716200/0xcbad34b2815723a7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.423292:0:14465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ee716200/0xcbad34b2815723a7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790710987.423444:0:14465:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:0.0:1790710987.423584:0:14465:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:0.0:1790710987.423626:0:14465:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:0.0:1790710987.423701:0:14465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c50c35b1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14465:1877696177085056:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1790710987.423748:0:14465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710987.423784:0:14465:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c8e73d80 going to sleep for 11 seconds 00000100:00100000:2.0:1790710987.423966:0:14469:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177085056 00000100:00100000:2.0:1790710987.423971:0:14469:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177085056 00000100:00100000:2.0:1790710987.424007:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790710987.424014:0:14469:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14465:x1877696177085056:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1790710987.424079:0:14469:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14465:x1877696177085056:12345-0@lo:1000:mdt00_001.0 Request processed in 65us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710987.424086:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790710987.424116:0:14465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c50c35b1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14465:1877696177085056:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1790710987.424878:0:14465:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1790710987.424943:0:14465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51d03f9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14465:1877696177085184:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1790710987.424981:0:14465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790710987.425005:0:14465:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51f4045f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790710987.425029:0:14469:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177085184 00000100:00100000:2.0:1790710987.425034:0:14469:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177085184 00000100:00100000:2.0:1790710987.425059:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790710987.425064:0:14469:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51d03fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14465:x1877696177085184:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1790710987.426538:0:14469:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51d03fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14465:x1877696177085184:12345-0@lo:1000:mdt00_001.0 Request processed in 1458us (1541us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1790710987.426550:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790710987.426661:0:14465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51d03f9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14465:1877696177085184:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1790710987.426698:0:14465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ee716200/0xcbad34b2815723a7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.426708:0:14465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ee716200/0xcbad34b2815723a7 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.426729:0:14465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ee716200/0xcbad34b2815723a7 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.426734:0:14465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51ee716200 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1790710987.426739:0:14465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ee716200/0xcbad34b2815723a7 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.426747:0:14465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ee716200/0xcbad34b2815723a7 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.426762:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c51cca25300) 00010000:00010000:0.0:1790710987.426765:0:14465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790710987.426769:0:14465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ee716200/0xcbad34b2815723a7 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.426775:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ee716200/0xcbad34b2815723a7 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.426805:0:14465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031000/0xcbad34b2815722ff lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.426811:0:14465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031000/0xcbad34b2815722ff lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.426817:0:14465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031000/0xcbad34b2815722ff lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.426823:0:14465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c0031000 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1790710987.426825:0:14465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031000/0xcbad34b2815722ff lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.426841:0:14465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031000/0xcbad34b2815722ff lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.426849:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c51c7c52f00) 00010000:00010000:0.0:1790710987.426852:0:14465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790710987.426858:0:14465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281572306 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000925 expref: 18 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.426869:0:14465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281572306 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000925 expref: 18 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.426878:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281572306 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000925 expref: 18 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.426909:0:14465:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0030000/0xcbad34b281572306 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.46@tcp remote: 0x566877b057000925 expref: 18 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710987.426922:0:14465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d60a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14465:1877696177085312:192.168.206.46@tcp:105: 00000100:00100000:0.0:1790710987.427029:0:14465:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c51c8e73c00 going to sleep for 11 seconds 00000100:00100000:3.0:1790710987.431077:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710987.431207:0:14467:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158231936 00000100:00100000:2.0:1790710987.431217:0:14467:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158231936 00000100:00100000:2.0:1790710987.431280:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 10 00000100:00100000:2.0:1790710987.431291:0:14467:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f409cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+19:14466:x1877696158231936:12345-192.168.206.46@tcp:49:dd.0 00000100:00100000:2.0:1790710987.431423:0:14467:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f409cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+19:14466:x1877696158231936:12345-192.168.206.46@tcp:49:dd.0 Request processed in 134us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710987.431431:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 10 00000100:00100000:0.0:1790710987.431747:0:14465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d60a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14465:1877696177085312:192.168.206.46@tcp:105: 00010000:00010000:0.0:1790710987.431771:0:14465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031000/0xcbad34b2815722ff lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.431780:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51c0031000/0xcbad34b2815722ff lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 16341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.431805:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ee716800/0xcbad34b2815723ae lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.431826:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ee716800/0xcbad34b2815723ae lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.431838:0:14465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ee716800/0xcbad34b2815723ae lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.431848:0:14465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ee716800/0xcbad34b2815723ae lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.431854:0:14465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ee716800/0xcbad34b2815723ae lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.431861:0:14465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ee716800/0xcbad34b2815723ae lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.431867:0:14465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51ee716800 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1790710987.431870:0:14465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ee716800/0xcbad34b2815723ae lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.431878:0:14465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ee716800/0xcbad34b2815723ae lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.431889:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c51c7c52f00) 00010000:00010000:0.0:1790710987.431892:0:14465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790710987.431896:0:14465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ee716800/0xcbad34b2815723ae lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.431902:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ee716800/0xcbad34b2815723ae lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.431912:0:14465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ee717000/0xcbad34b2815723a0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.431924:0:14465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ee717000/0xcbad34b2815723a0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.431931:0:14465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ee717000/0xcbad34b2815723a0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.431936:0:14465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51ee717000 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1790710987.431940:0:14465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ee717000/0xcbad34b2815723a0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.431948:0:14465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ee717000/0xcbad34b2815723a0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.431956:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c51c7c52f00) 00010000:00010000:0.0:1790710987.431959:0:14465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790710987.431962:0:14465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ee717000/0xcbad34b2815723a0 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.431967:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ee717000/0xcbad34b2815723a0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710987.432644:0:14465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f3e77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+18:14467:x1877696158231680:12345-192.168.206.46@tcp:57:lhsmtool_posix.0 Request processed in 14064us (14326us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1790710987.432653:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 53 00000020:00080000:0.0:1790710987.432658:0:14465:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1790710987.435696:0:14496:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1790710987.435704:0:14496:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790710987.435735:0:14496:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1790710987.435816:0:14496:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1790710987.440729:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710987.440811:0:14468:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158232192 00000100:00100000:1.0:1790710987.441023:0:14468:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158232192 00000100:00100000:1.0:1790710987.441080:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 11 00000100:00100000:1.0:1790710987.441090:0:14468:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+18:14467:x1877696158232192:12345-192.168.206.46@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1790710987.442240:0:14468:0:(mdd_object.c:4180:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1790710987.442655:0:14468:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:1.0:1790710987.442711:0:14468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ff135e00/0xcbad34b2815723b5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710987.442730:0:14468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ff135e00/0xcbad34b2815723b5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710987.442742:0:14468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ff135e00/0xcbad34b2815723b5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710987.442750:0:14468:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ff135e00/0xcbad34b2815723b5 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710987.442757:0:14468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ff135e00/0xcbad34b2815723b5 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710987.442763:0:14468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ff135e00/0xcbad34b2815723b5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710987.443071:0:14468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790710987.443196:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790710987.443204:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ff135e00/0xcbad34b2815723b5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.443211:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51ff135e00 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:0.0:1790710987.443227:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ff135e00/0xcbad34b2815723b5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.443236:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ff135e00/0xcbad34b2815723b5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.443250:0:14453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c51cca25300) 00010000:00010000:0.0:1790710987.443253:0:14453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1790710987.443258:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ff135e00/0xcbad34b2815723b5 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.443265:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c51ff135e00/0xcbad34b2815723b5 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.443289:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790710987.443291:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790710987.443293:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790710987.443417:0:14468:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+20:14467:x1877696158232192:12345-192.168.206.46@tcp:35:lhsmtool_posix.0 Request processed in 2324us (2691us total) trans 8589934622 rc 0/0 00000100:00100000:1.0:1790710987.443543:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 11 00000020:00080000:1.0:1790710987.443549:0:14468:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1790710987.600559:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710987.600700:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:2.0:1790710987.602937:0:15153:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158232320 00000100:00100000:2.0:1790710987.602959:0:15153:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158232320 00000100:00100000:3.0:1790710987.603522:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710987.604847:0:15155:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158232448 00000100:00100000:1.0:1790710987.604865:0:15155:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158232448 00000100:00100000:2.0:1790710987.604910:0:15153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 0 00000100:00100000:2.0:1790710987.604927:0:15153:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f3e77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+8:2358:x1877696158232320:12345-192.168.206.46@tcp:4:dd.0 00002000:00010000:2.0:1790710987.605000:0:15153:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6abc14ca, atime: 0x6abc14c9, ctime: 0x6abc14ca, blocks: 0x1 00010000:00010000:2.0:1790710987.605012:0:15153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c4a7292/0xcbad34b2815723bc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710987.605034:0:15153:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=464s v=(0 0) 00010000:00010000:2.0:1790710987.605442:0:15153:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790710987.605451:0:15153:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c4a7292/0xcbad34b2815723bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710987.605469:0:15153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c4a7292/0xcbad34b2815723bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710987.605873:0:15154:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158232576 00000100:00100000:0.0:1790710987.605881:0:15154:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158232576 00000001:00080000:1.0:1790710987.702496:0:6720:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934596 is committed 00000001:00080000:1.0:1790710987.702533:0:6720:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934595 is committed 00000001:00080000:1.0:1790710987.702565:0:6720:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00000001:00080000:1.0:1790710987.702578:0:6720:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00002000:00010000:0.0:1790710987.702859:0:15153:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:0.0:1790710987.702865:0:15153:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1790710986 -> 1790710987 00002000:00010000:0.0:1790710987.702868:0:15153:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:0.0:1790710987.702882:0:15153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c4a7292/0xcbad34b2815723bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.702894:0:15153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c4a7292/0xcbad34b2815723bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.702903:0:15153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c4a7292/0xcbad34b2815723bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.702930:0:15153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51f43f8a00 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:0.0:1790710987.702935:0:15153:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c4a7292/0xcbad34b2815723bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.702944:0:15153:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c4a7292/0xcbad34b2815723bc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.702972:0:15153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c4a7292/0xcbad34b2815723bc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.702980:0:15153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c4a7292/0xcbad34b2815723bc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710987.703078:0:15153:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f3e77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+7:2358:x1877696158232320:12345-192.168.206.46@tcp:4:dd.0 Request processed in 98151us (102531us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1790710987.703088:0:15153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 0 00000100:00100000:0.0:1790710987.703119:0:15153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 1 00000100:00100000:0.0:1790710987.703174:0:15153:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f3e74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+6:2359:x1877696158232448:12345-192.168.206.46@tcp:4:dd.0 00002000:00010000:0.0:1790710987.703215:0:15153:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 1048576, mtime: 0x6abc14cb, atime: 0x6abc14c9, ctime: 0x0, blocks: 0x803 00010000:00010000:0.0:1790710987.703222:0:15153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3631682/0xcbad34b2815723c3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.703234:0:15153:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1790710987.703239:0:15153:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790710987.703245:0:15153:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a3631682/0xcbad34b2815723c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.703264:0:15153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a3631682/0xcbad34b2815723c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790710987.761651:0:6720:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00002000:00010000:0.0:1790710987.761844:0:15153:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 1048576 -> 2097152 00002000:00010000:0.0:1790710987.761850:0:15153:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 2051 -> 4103 00010000:00010000:0.0:1790710987.761867:0:15153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3631682/0xcbad34b2815723c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.761882:0:15153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a3631682/0xcbad34b2815723c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.761892:0:15153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a3631682/0xcbad34b2815723c3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.761900:0:15153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51ee717000 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:0.0:1790710987.761906:0:15153:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3631682/0xcbad34b2815723c3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.761915:0:15153:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3631682/0xcbad34b2815723c3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.761948:0:15153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a3631682/0xcbad34b2815723c3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.761957:0:15153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a3631682/0xcbad34b2815723c3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710987.762109:0:15153:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f3e74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+6:2359:x1877696158232448:12345-192.168.206.46@tcp:4:dd.0 Request processed in 58974us (161401us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1790710987.762122:0:15153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 1 00000100:00100000:0.0:1790710987.762205:0:15153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 2 00000100:00100000:0.0:1790710987.762220:0:15153:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+5:2359:x1877696158232576:12345-192.168.206.46@tcp:4:dd.0 00002000:00010000:0.0:1790710987.762272:0:15153:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 2097152, mtime: 0x6abc14cb, atime: 0x6abc14c9, ctime: 0x0, blocks: 0x1007 00010000:00010000:0.0:1790710987.762280:0:15153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb234575/0xcbad34b2815723ca lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.762294:0:15153:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1790710987.762299:0:15153:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790710987.762307:0:15153:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb234575/0xcbad34b2815723ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.762321:0:15153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb234575/0xcbad34b2815723ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790710987.831564:0:6720:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00002000:00010000:0.0:1790710987.831753:0:15153:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:0.0:1790710987.831759:0:15153:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:0.0:1790710987.831778:0:15153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb234575/0xcbad34b2815723ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.831794:0:15153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb234575/0xcbad34b2815723ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.831831:0:15153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb234575/0xcbad34b2815723ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.831839:0:15153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51ee716800 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:0.0:1790710987.831845:0:15153:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb234575/0xcbad34b2815723ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.831856:0:15153:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb234575/0xcbad34b2815723ca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.831880:0:15153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb234575/0xcbad34b2815723ca lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710987.831888:0:15153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb234575/0xcbad34b2815723ca lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710987.832032:0:15153:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+5:2359:x1877696158232576:12345-192.168.206.46@tcp:4:dd.0 Request processed in 69810us (228511us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1790710987.832044:0:15153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 2 00000100:00100000:1.0:1790710987.850606:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710987.850671:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710987.850707:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710987.850741:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:1.0:1790710987.850762:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.46@tcp (source: 12345-192.168.206.46@tcp) 00000100:00100000:3.0:1790710987.851077:0:15155:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158232704 00000100:00100000:3.0:1790710987.851089:0:15155:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158232704 00000100:00100000:3.0:1790710987.851236:0:15155:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158232960 00000100:00100000:3.0:1790710987.851240:0:15155:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158232960 00000100:00100000:3.0:1790710987.851255:0:15155:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158233216 00000100:00100000:3.0:1790710987.851258:0:15155:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158233216 00000100:00100000:3.0:1790710987.851274:0:15155:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158232832 00000100:00100000:3.0:1790710987.851277:0:15155:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158232832 00000100:00100000:2.0:1790710987.851294:0:15153:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696158233088 00000100:00100000:2.0:1790710987.851302:0:15153:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696158233088 00000100:00100000:3.0:1790710987.851305:0:15155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 3 00000100:00100000:3.0:1790710987.851318:0:15155:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4e6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+9:2357:x1877696158232704:12345-192.168.206.46@tcp:4:dd.0 00002000:00010000:3.0:1790710987.851395:0:15155:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 3145728, mtime: 0x6abc14cb, atime: 0x6abc14c9, ctime: 0x0, blocks: 0x1807 00010000:00010000:3.0:1790710987.851408:0:15155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e460ef8/0xcbad34b2815723d1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710987.851430:0:15155:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=465s v=(0 0) 00010000:00010000:3.0:1790710987.851456:0:15155:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790710987.851464:0:15155:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005e460ef8/0xcbad34b2815723d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710987.851483:0:15155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005e460ef8/0xcbad34b2815723d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790710987.911878:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1790710987.927861:0:6720:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00002000:00010000:1.0:1790710987.928384:0:15155:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 3145728 -> 4194304 00002000:00010000:1.0:1790710987.928390:0:15155:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 0 -> 1790710987 00002000:00010000:1.0:1790710987.928392:0:15155:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:1.0:1790710987.928411:0:15155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e460ef8/0xcbad34b2815723d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710987.928426:0:15155:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005e460ef8/0xcbad34b2815723d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710987.928436:0:15155:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005e460ef8/0xcbad34b2815723d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710987.928444:0:15155:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51c1645c00 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:1.0:1790710987.928451:0:15155:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005e460ef8/0xcbad34b2815723d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710987.928480:0:15155:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005e460ef8/0xcbad34b2815723d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710987.928505:0:15155:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005e460ef8/0xcbad34b2815723d1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710987.928514:0:15155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005e460ef8/0xcbad34b2815723d1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710987.928775:0:15155:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4e6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+9:2357:x1877696158232704:12345-192.168.206.46@tcp:4:dd.0 Request processed in 77453us (78177us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1790710987.928787:0:15155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 3 00000100:00100000:1.0:1790710987.928829:0:15155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 4 00000100:00100000:1.0:1790710987.928854:0:15155:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4e6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+8:2357:x1877696158232960:12345-192.168.206.46@tcp:4:dd.0 00002000:00010000:1.0:1790710987.928904:0:15155:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 4194304, mtime: 0x6abc14cb, atime: 0x6abc14c9, ctime: 0x6abc14cb, blocks: 0x2007 00010000:00010000:1.0:1790710987.928912:0:15155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000775e9b38/0xcbad34b2815723d8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710987.928925:0:15155:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=465s v=(0 0) 00010000:00010000:1.0:1790710987.928931:0:15155:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790710987.928938:0:15155:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000775e9b38/0xcbad34b2815723d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710987.928951:0:15155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000775e9b38/0xcbad34b2815723d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790710988.000334:0:6720:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934602 is committed 00002000:00010000:1.0:1790710988.000713:0:15155:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 4194304 -> 6291456 00002000:00010000:1.0:1790710988.000719:0:15155:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 10247 00010000:00010000:1.0:1790710988.000745:0:15155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000775e9b38/0xcbad34b2815723d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710988.000761:0:15155:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000775e9b38/0xcbad34b2815723d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710988.000771:0:15155:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000775e9b38/0xcbad34b2815723d8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710988.000779:0:15155:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51ff135200 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:1.0:1790710988.000784:0:15155:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000775e9b38/0xcbad34b2815723d8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710988.000793:0:15155:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000775e9b38/0xcbad34b2815723d8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710988.000817:0:15155:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000775e9b38/0xcbad34b2815723d8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790710988.000825:0:15155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000775e9b38/0xcbad34b2815723d8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790710988.000965:0:15155:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4e6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+8:2357:x1877696158232960:12345-192.168.206.46@tcp:4:dd.0 Request processed in 72108us (150285us total) trans 8589934602 rc 0/0 00000100:00100000:1.0:1790710988.000997:0:15155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 4 00000100:00100000:1.0:1790710988.001041:0:15155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 5 00000100:00100000:1.0:1790710988.001734:0:15155:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4e6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+7:2357:x1877696158233216:12345-192.168.206.46@tcp:4:dd.0 00002000:00010000:2.0:1790710988.002217:0:15155:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 6291456, mtime: 0x6abc14cb, atime: 0x6abc14c9, ctime: 0x6abc14cb, blocks: 0x2807 00010000:00010000:2.0:1790710988.002229:0:15155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d6d0474/0xcbad34b2815723df lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710988.002256:0:15155:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=465s v=(0 0) 00010000:00010000:2.0:1790710988.002260:0:15155:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790710988.002268:0:15155:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d6d0474/0xcbad34b2815723df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790710988.002283:0:15155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d6d0474/0xcbad34b2815723df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790710988.082605:0:6720:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934603 is committed 00002000:00010000:0.0:1790710988.087965:0:15155:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7654321 00002000:00010000:0.0:1790710988.087980:0:15155:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 10247 -> 12295 00010000:00010000:0.0:1790710988.087998:0:15155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d6d0474/0xcbad34b2815723df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710988.088016:0:15155:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d6d0474/0xcbad34b2815723df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710988.088048:0:15155:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d6d0474/0xcbad34b2815723df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710988.088058:0:15155:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51f43f9a00 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:0.0:1790710988.088064:0:15155:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d6d0474/0xcbad34b2815723df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710988.088074:0:15155:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d6d0474/0xcbad34b2815723df lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710988.088102:0:15155:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d6d0474/0xcbad34b2815723df lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710988.088111:0:15155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d6d0474/0xcbad34b2815723df lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710988.088304:0:15155:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4e6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+7:2357:x1877696158233216:12345-192.168.206.46@tcp:4:dd.0 Request processed in 87246us (237587us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1790710988.088315:0:15155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 5 00000100:00100000:0.0:1790710988.088361:0:15155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 6 00000100:00100000:0.0:1790710988.088387:0:15155:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4e6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+6:2357:x1877696158232832:12345-192.168.206.46@tcp:4:dd.0 00002000:00010000:0.0:1790710988.088440:0:15155:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 7654321, mtime: 0x6abc14cb, atime: 0x6abc14c9, ctime: 0x6abc14cb, blocks: 0x3007 00010000:00010000:0.0:1790710988.088448:0:15155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb234575/0xcbad34b2815723e6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710988.088473:0:15155:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1790710988.088479:0:15155:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790710988.088486:0:15155:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb234575/0xcbad34b2815723e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710988.088499:0:15155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb234575/0xcbad34b2815723e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790710988.140091:0:6720:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934604 is committed 00002000:00010000:0.0:1790710988.140239:0:15155:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:0.0:1790710988.140259:0:15155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb234575/0xcbad34b2815723e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710988.140288:0:15155:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb234575/0xcbad34b2815723e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710988.140299:0:15155:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb234575/0xcbad34b2815723e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710988.140310:0:15155:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51ee716800 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:0.0:1790710988.140316:0:15155:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb234575/0xcbad34b2815723e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710988.140326:0:15155:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb234575/0xcbad34b2815723e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710988.140350:0:15155:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb234575/0xcbad34b2815723e6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710988.140381:0:15155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb234575/0xcbad34b2815723e6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710988.140498:0:15155:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4e6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+6:2357:x1877696158232832:12345-192.168.206.46@tcp:4:dd.0 Request processed in 52123us (289749us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1790710988.140512:0:15155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 6 00000100:00100000:0.0:1790710988.140558:0:15155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.46@tcp, seq: 7 00000100:00100000:0.0:1790710988.140569:0:15155:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4e6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+5:2357:x1877696158233088:12345-192.168.206.46@tcp:4:dd.0 00002000:00010000:0.0:1790710988.140613:0:15155:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 7654321, mtime: 0x6abc14cb, atime: 0x6abc14c9, ctime: 0x6abc14cb, blocks: 0x3807 00010000:00010000:0.0:1790710988.140620:0:15155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3631682/0xcbad34b2815723ed lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710988.140637:0:15155:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1790710988.140642:0:15155:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790710988.140649:0:15155:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a3631682/0xcbad34b2815723ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710988.140664:0:15155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a3631682/0xcbad34b2815723ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790710988.215223:0:15155:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:0.0:1790710988.215250:0:15155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3631682/0xcbad34b2815723ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710988.215266:0:15155:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a3631682/0xcbad34b2815723ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710988.215294:0:15155:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a3631682/0xcbad34b2815723ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710988.215303:0:15155:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c51ee717000 already unused, calling callback (ffffffffc1692ac0) 00010000:00010000:0.0:1790710988.215308:0:15155:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3631682/0xcbad34b2815723ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710988.215319:0:15155:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3631682/0xcbad34b2815723ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710988.215343:0:15155:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a3631682/0xcbad34b2815723ed lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790710988.215352:0:15155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a3631682/0xcbad34b2815723ed lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790710988.215602:0:15155:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4e6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07f3a30d-977e-4e8f-a2f1-7a826af5c45b+7:2357:x1877696158233088:12345-192.168.206.46@tcp:4:dd.0 Request processed in 75028us (364830us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1790710988.215614:0:15155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.46@tcp, seq: 7 00000001:00080000:3.0:1790710988.215759:0:6720:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00010000:00010000:1.0:1790710988.935696:0:16043:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790710989.575554:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51d03f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1877696177085440:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790710989.575660:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710989.575999:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9ca0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1877696177085696:0@lo:400:kworker.0 00000100:00100000:3.0:1790710989.576035:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710989.576063:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1790710989.576069:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f4d5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:3312:1877696177085568:0@lo:400:kworker.0 00000100:00100000:3.0:1790710989.576105:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710989.576124:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9ca0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1877696177086080:0@lo:400:kworker.0 00000100:00100000:3.0:1790710989.576194:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710989.576228:0:15148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177085696 00000100:00100000:3.0:1790710989.576238:0:15148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177085696 00000100:00100000:3.0:1790710989.576527:0:15148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790710989.576540:0:15148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9ca1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1877696177085696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790710989.576611:0:15148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9ca1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1877696177085696:12345-0@lo:400:kworker.0 Request processed in 74us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710989.576619:0:15148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1790710989.576682:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790710989.576695:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9ca2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1877696177086208:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790710989.576722:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790710989.576759:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9ca0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1877696177085696:0@lo:400:kworker.0 00000100:00100000:3.0:1790710989.576788:0:15151:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177085440 00000100:00100000:3.0:1790710989.576792:0:15151:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177085440 00000100:00100000:3.0:1790710989.576814:0:15151:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177086208 00000100:00100000:3.0:1790710989.576816:0:15151:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177086208 00000100:00100000:3.0:1790710989.576827:0:15151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790710989.576833:0:15151:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877696177085440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790710989.576869:0:15151:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 6815744 granted 62980096 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1790710989.576903:0:15151:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877696177085440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (1243us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710989.576909:0:15151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790710989.576921:0:15151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790710989.576926:0:15151:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9ca3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877696177086208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790710989.576946:0:15151:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790710989.577087:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9ca3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877696177085824:0@lo:400:kworker.0 00000100:00100000:0.0:1790710989.577124:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710989.577178:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790710989.577185:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c51f9ca0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1877696177085952:0@lo:400:kworker.0 00000100:00100000:0.0:1790710989.577208:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790710989.577235:0:14459:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177085568 00000100:00100000:0.0:1790710989.577247:0:14459:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177085568 00000100:00100000:0.0:1790710989.577282:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1790710989.577288:0:14459:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f470e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+19:3312:x1877696177085568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790710989.577405:0:14464:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177086080 00000100:00100000:2.0:1790710989.577410:0:14464:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177086080 00000100:00100000:2.0:1790710989.577443:0:14464:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177085824 00000100:00100000:2.0:1790710989.577446:0:14464:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177085824 00000100:00100000:2.0:1790710989.577460:0:14464:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696177085952 00000100:00100000:2.0:1790710989.577462:0:14464:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696177085952 00000100:00100000:2.0:1790710989.577477:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790710989.577483:0:14464:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f9ca2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1877696177086080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790710989.577582:0:15151:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9ca3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877696177086208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 655us (858us total) trans 0 rc 0/0 00000100:00100000:3.0:1790710989.577589:0:15151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1790710989.577606:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790710989.577611:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790710989.577635:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:3.0:1790710989.577641:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c51f3e74a80, transno 8589934595 00000004:00080000:3.0:1790710989.577653:0:3310:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:3.0:1790710989.577677:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51d03f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1877696177085440:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790710989.579005:0:16341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790710989.579027:0:16341:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51f4d60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877696177085824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790710989.579159:0:16341:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f4d60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877696177085824:12345-0@lo:400:kworker.0 Request processed in 109us (2002us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710989.579167:0:16341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790710989.579196:0:16341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790710989.579204:0:16341:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9c51ff87d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877696177085952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790710989.579238:0:16341:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51ff87d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877696177085952:12345-0@lo:400:kworker.0 Request processed in 35us (2029us total) trans 0 rc 0/0 00000100:00100000:1.0:1790710989.579244:0:16341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790710989.579324:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9ca0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1877696177085952:0@lo:400:kworker.0 00000100:00100000:1.0:1790710989.579338:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9ca3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877696177085824:0@lo:400:kworker.0 00000100:00100000:0.0:1790710989.582911:0:14459:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f470e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4743a9b-e5c2-4c44-ad7f-283ce8b38224+19:3312:x1877696177085568:12345-0@lo:400:kworker.0 Request processed in 5605us (6787us total) trans 0 rc 0/0 00000100:00100000:0.0:1790710989.582932:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1790710989.590521:0:14464:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9c51f9ca2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1877696177086080:12345-0@lo:400:kworker.0 Request processed in 13013us (14301us total) trans 0 rc 0/0 00000100:00100000:2.0:1790710989.590544:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1790710989.590924:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9ca2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1877696177086208:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790710989.590958:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f4d5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b4743a9b-e5c2-4c44-ad7f-283ce8b38224:3312:1877696177085568:0@lo:400:kworker.0 00000100:00100000:3.0:1790710989.591607:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c51f9ca0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1877696177086080:0@lo:400:kworker.0 00000001:02000400:2.0:1790710989.894853:0:16735:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:1.0:1790710989.960327:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790710990.987022:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29013 lines, 29013 kept, 0 dropped, 0 bad.